-- Logs begin at Tue 2022-01-18 11:58:17 UTC, end at Tue 2022-01-18 13:38:48 UTC. -- Jan 18 12:36:55.476002 dv-cinder-825102-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 18 12:36:55.486951 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jan 18 12:36:55 2022] *** Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: nodename: dv-cinder-825102-1-iscsi Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: machine: x86_64 Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: clock source: unix Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: pcre jit disabled Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: detected number of CPU cores: 4 Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: current working directory: / Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: detected binary path: /usr/bin/uwsgi-core Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: your processes number limit is 47680 Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: your memory page size is 4096 bytes Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: detected max file descriptor number: 2048 Jan 18 12:36:55.489628 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: lock engine: pthread robust mutexes Jan 18 12:36:55.490467 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: thunder lock: enabled Jan 18 12:36:55.490467 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 18 12:36:55.490467 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 18 12:36:55.533514 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: Python main interpreter initialized at 0x55adb51c49c0 Jan 18 12:36:55.533514 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: python threads support enabled Jan 18 12:36:55.533514 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: your server socket listen backlog is limited to 100 connections Jan 18 12:36:55.533514 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: your mercy for graceful operations on workers is 90 seconds Jan 18 12:36:55.534003 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: mapped 403077 bytes (393 KB) for 2 cores Jan 18 12:36:55.534003 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: *** Operational MODE: preforking *** Jan 18 12:36:55.534226 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: *** uWSGI is running in multiple interpreter mode *** Jan 18 12:36:55.534226 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: spawned uWSGI master process (pid: 66290) Jan 18 12:36:55.534444 dv-cinder-825102-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 18 12:36:55.539334 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: spawned uWSGI worker 1 (pid: 66302, cores: 1) Jan 18 12:36:55.539334 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: spawned uWSGI worker 2 (pid: 66304, cores: 1) Jan 18 12:36:55.539334 dv-cinder-825102-1-iscsi devstack@keystone.service[66290]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 18 12:36:58.477113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 12:36:58.477662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 12:36:58.477662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] command line args: [] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 12:36:58.477842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 12:36:58.478020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ================================================================================ {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 12:36:58.478278 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] admin_token = **** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.478525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] config_dir = [] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.478710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.478891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] config_source = [] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.479041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 18 12:36:58.479448 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] debug = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.479531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 18 12:36:58.479597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.479848 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] command line args: [] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 18 12:36:58.479920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.479920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.480031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 18 12:36:58.480088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.480152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ================================================================================ {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 18 12:36:58.480302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.480377 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] admin_token = **** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.480665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] list_limit = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.480773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] config_dir = [] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.480846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] log_config_append = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.480905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.480961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] config_source = [] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] log_dir = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] debug = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] log_file = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481437 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] insecure_debug = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481875 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.481938 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482101 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] list_limit = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] log_config_append = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] log_dir = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.482990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.483104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] log_file = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.483186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.483300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.483398 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.483525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.483607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.483745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.483829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.483997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.484076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.484202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.484279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.484393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.484548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.484673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.484815 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.87/identity {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] publish_errors = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.485951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.486078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.486201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] notification_format = cadf {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.486366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.486675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] standard_threads = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.491696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.491696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.491696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.491696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] use_journal = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.491696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] use_json = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.491696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] use_stderr = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.491696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] use_syslog = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.492437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.492552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.492552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.492756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.87/identity {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.492863 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.493382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] publish_errors = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.493472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.493472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.493472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.493657 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.493726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.493813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.493914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.493993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.493993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.494131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.494131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.494261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.494334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.494409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] standard_threads = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.494484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.494484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.494484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.494484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.494484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.494796 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] strict_password_check = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.494866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.494942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.495022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.495168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] use_eventlog = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.495252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.495428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] use_journal = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.495509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.495580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] use_json = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.495580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] use_stderr = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.495717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.495786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] use_syslog = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.495854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.495927 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] watch_log_file = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 18 12:36:58.495997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.496944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497454 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497738 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.497971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498294 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.498976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499492 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499711 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.499946 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500021 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500860 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.500936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.501096 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.501179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.501334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.501416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.501567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.501644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.501806 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.501884 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.502603 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.503138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.503415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.503509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.503661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.503741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.503903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.503983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.504155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.504266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.504417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.504544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.504663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.504794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.504989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.505078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.505150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.505262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.505379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.505486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.505661 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.505747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.505911 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.505991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.506151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.506229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.506393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.506470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.506629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.506708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.506865 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.506942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.507107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.507189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.507365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.507446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.507642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.507719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.507881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.507957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.508113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] auth.external = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.508192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.508344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.508422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.508597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.enabled = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.508685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.508840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.508924 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.509081 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] auth.password = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.509163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.509312 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] auth.token = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.509398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.509551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.509629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.509782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.509859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.510028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.510114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.510259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.510337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.510506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.510585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.510742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.510826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.510973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.511051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.511207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.511285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] credential.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.511475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.511555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.511716 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.511826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.511974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.512062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.512217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.512294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.512458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.512536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.512693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.512776 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.512939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.513016 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.513192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.513272 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.513433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.513509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.513670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] auth.external = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.513755 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.513905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] auth.mapped = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.513984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.514186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.514261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.514434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.514519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.514673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] auth.password = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.514757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.514952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] auth.token = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.515039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.515143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] federation.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.515232 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.515404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] catalog.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.515631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.515631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.515754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.515879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.515968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.516107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.516184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.516354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.516433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.516589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.516676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.516829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] credential.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.516913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.517078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.517153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] credential.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.517326 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.517410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.517700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.518301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.518435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.518675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.518924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.519017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.519192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.519270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.519468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.519547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.519727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.519816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.519991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.520083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.520238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.520315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.520480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.520558 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.520733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.520818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.520985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.521063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.521218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.521302 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.521450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.521536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.521681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.521759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.521925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.522004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] federation.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.522171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.522260 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.522417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.522495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] federation.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.522674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.522759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.522913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.523035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.523171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.523258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.523434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.523522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.523696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.523789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.523939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.524018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.524173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.524256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.524440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.524530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.524695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.524779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.524937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.525016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.525190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.525270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.525442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.525521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.525673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.525750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.525910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.525989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.526161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.526238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.526402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.526480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.526645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.526727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.526891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.526968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.527124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.527202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.527385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.527469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.527620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.527743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.527852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.527929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.528087 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.528166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.528330 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.528409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.528568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.528646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.528806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.528885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.529054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.529132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.529310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.529389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.529547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.529627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.529780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.529865 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.530013 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.530091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.530257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.530342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.530491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.530600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.530728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.530808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.530962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.531042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.531192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.531271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.531467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.531556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.531708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.531788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.531945 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.532022 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.532191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.532269 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.532426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.532505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.532674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.532766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.532907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.532988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.533139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.533247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.533425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.533662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.533896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.533979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.534126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.534206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.password = **** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.534371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.534450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.534617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.534695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.534864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.534949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.535105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.535183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.535368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.535450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.535600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.535680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.535847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.535926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.536085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.536163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.536319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.536398 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.536553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.536630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.536788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.536866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.537035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.537113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.537275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.537354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.537508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.537585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.537742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.537821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.537978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.538055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.538224 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.538369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.538456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.538612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.538691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.538868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.538946 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.539125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.539205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.539399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.539482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.539632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.539710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.539868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.539948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.540103 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] resource.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.540185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.540580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.540661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.540825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.540906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.541064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.541145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.541317 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.541394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.541565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.541645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.541801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.541879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.542046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.542131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.542281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.542362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.542518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.542594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.542749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] role.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.542825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.542996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] role.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.543075 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.543225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.543328 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.543498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.543582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.543739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.543817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.543982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.544060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.544229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.544307 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.544470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.544549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.544711 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.544787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] policy.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.544954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.545030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.545196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.545275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.545428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.545506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.545666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] receipt.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.545742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.545909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.545988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.546158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.546234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.546402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.546478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.546639 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.546831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.546909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.547068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.547145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] resource.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.547366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.547466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.547591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.547670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] resource.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.547839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.547917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.548090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.548175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.548323 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.548407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.548570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] revoke.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.548647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.548884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.548978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.549229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.549464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.549635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.549720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.549886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] role.cache_time = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.549966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.550129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] role.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.550271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.550384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] role.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.550509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.550620 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] role.list_limit = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.550757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.550874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.550995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.551137 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.551223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.551419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.551502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.551675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.551754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] token.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.551921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.551997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.552168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.552248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.552448 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.552536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.552655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.552733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.552888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.552966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.553123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.553199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.553365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.553442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.553605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.553685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.553850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.553927 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.554084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.554279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.554441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.554517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.554587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.554759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.554837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.555002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.555088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.555232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.555355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.555498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.555587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.555759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.555846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.556020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.connection = **** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.556097 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.556266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.556343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.556507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.556592 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.556747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.556825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.556985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.557061 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.557223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.557326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.557476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.557555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.557708 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.557786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.557944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.558031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.558189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.558271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.558425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.558502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.558662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] token.cache_time = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.558748 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.558893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.558970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] token.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.559139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.559217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.559385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.559467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] token.provider = fernet {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.559631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.559709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.559861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.559939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.560100 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.560180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.560333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.560411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.560487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66302) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 12:36:58.560584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.560833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.561086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] trust.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.561327 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.561569 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.561807 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.562057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.562310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.562545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.562792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.563060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.563342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.connection = **** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.563597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.563851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.564118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.564362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.565655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.565920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.566172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.566422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.566678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.566931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.567183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.567464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.567723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.567968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.568223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.568460 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.568707 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.568948 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 18 12:36:58.569130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=66304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 18 12:36:58.589801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.590023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.590247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.593752 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.593984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.594211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.602229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.604123 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.631181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.631428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.634071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.634308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.686783 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.689074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.739831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.740008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.741610 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.741847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.805811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.806032 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.806205 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.806335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.806425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.806509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.806649 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.806751 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.806871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.806954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.807090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.807331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.832085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.832321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.832537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.832759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.832975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.833059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.833184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.833266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.833392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.833484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.833630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.833854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.834072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.834288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.844578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.844690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.857892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.858121 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.858215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.858349 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.858454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.858563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.858648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.858778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.858861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.858989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.859074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.859197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.859280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66304) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.859435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=66302) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 18 12:36:58.877011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.877786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 18 12:36:58.878123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.878320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 18 12:36:58.878586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.878671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.878827 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.878905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 18 12:36:58.879082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.879193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.879357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.879442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 18 12:36:58.879697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.879966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.880226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.880487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.889787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.890060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.890325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.890601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.890831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.891106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.891403 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.891686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.898624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.900275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.901825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.902097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.902374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.902652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.902930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.903185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.903428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.903528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.903711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.903793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.903981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.904062 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.904248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.904331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.904508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.904589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.904777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.905046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.905320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.905589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.905860 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.906125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.930925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.932482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.932756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.933097 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.934643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.934916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.937796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.938184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.938460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.941101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.941486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.941771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.946046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.946320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.948811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.949096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.950538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.950818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.951094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.951395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.951675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.951946 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.952211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.952475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.953392 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.953680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.953966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.954249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.954524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.954802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.955110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.955843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.971448 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.971723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.974295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.974616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.976098 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.978990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.979738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.980027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.983201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.983523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.984804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.988763 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.989371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.992358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.992599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.992870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:58.993007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.993163 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.993438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.993719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.996521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.996827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.997152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.997398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.997681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:58.997959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.012874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.013154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.013445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.013702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.017774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.018431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.018704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.018993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.021264 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.022998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.023278 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.026239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.026517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.026601 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.026816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.027094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.027399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.028373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.028664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.031591 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.031876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.032179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.032459 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.032736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.040961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.041230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.041505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.041783 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.042058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.042336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.042613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.046355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.046638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.046917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.047195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.047499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.047800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.048076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.060482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.065726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.067438 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.069195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.070715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.071871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.072304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.072573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.072849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.075132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.076713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.078285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.078564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.078847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.149173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.150732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.153813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.154098 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.154377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.154657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.156607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.158725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.162407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.162700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.162986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.163272 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.164108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.164395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.164681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.172469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66302) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.172569 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.172743 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.172836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.173025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.173131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.173299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.173567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.174535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.174813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.175083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.175375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.175642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.175927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.176192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.176454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.176804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66302) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.181739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=66304) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 18 12:36:59.182018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.182320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.182594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.182864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.183143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.183487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.183765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.184036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.184312 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.184599 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.184868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.185134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.185491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=66304) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 18 12:36:59.213215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55adb51c49c0 pid: 66302 (default app) Jan 18 12:36:59.216500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbf953-0212-46fe-961d-d707492c9ef2 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:36:59.216800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbf953-0212-46fe-961d-d707492c9ef2 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:36:59.217085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbf953-0212-46fe-961d-d707492c9ef2 None None] PATH_INFO: `/v3` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:36:59.221806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1/1] 10.222.0.87 () {50 vars in 791 bytes} [Tue Jan 18 12:36:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:36:59.224313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55adb51c49c0 pid: 66304 (default app) Jan 18 12:37:06.101006 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192783e-4558-4da5-8f3e-4240b92e5388 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:06.101493 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192783e-4558-4da5-8f3e-4240b92e5388 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:06.101582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192783e-4558-4da5-8f3e-4240b92e5388 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:06.103585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 2/2] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 12:37:06.110808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:06.111745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:06.111745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:06.151703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG oslo_db.sqlalchemy.engines [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 18 12:37:06.299741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG passlib.handlers.bcrypt [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66304) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Jan 18 12:37:06.300145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG passlib.handlers.bcrypt [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66304) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Jan 18 12:37:06.362370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:06.363911 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:06.469774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1/3] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:06 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:37:06.642443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192783e-4558-4da5-8f3e-4240b92e5388 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:06.686300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG oslo_db.sqlalchemy.engines [None req-e192783e-4558-4da5-8f3e-4240b92e5388 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=66302) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Jan 18 12:37:06.786666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192783e-4558-4da5-8f3e-4240b92e5388 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:06.790833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944f9f3-197b-4a08-a57a-03e6b5276473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:06.791526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f9f3-197b-4a08-a57a-03e6b5276473 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:06.791814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f9f3-197b-4a08-a57a-03e6b5276473 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:06.792094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f9f3-197b-4a08-a57a-03e6b5276473 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:06.800960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944f9f3-197b-4a08-a57a-03e6b5276473 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:06.833892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3944f9f3-197b-4a08-a57a-03e6b5276473 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 18 12:37:06.834225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3944f9f3-197b-4a08-a57a-03e6b5276473 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:06.843772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 3/4] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:06 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:06.850456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:06.862218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318c2d2-59a1-4c2d-9424-1e86eaeb33ea None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:06.866241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9dea38-1cfb-4038-953b-912ffb9ef63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:06.867039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dea38-1cfb-4038-953b-912ffb9ef63e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:06.867351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dea38-1cfb-4038-953b-912ffb9ef63e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:06.867639 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dea38-1cfb-4038-953b-912ffb9ef63e admin admin] PATH_INFO: `/v3/projects/efd990fcb71545ffb5735fe49db625b4` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:06.868902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dea38-1cfb-4038-953b-912ffb9ef63e admin admin] RBAC: Authorizing `identity:get_project(project_id=efd990fcb71545ffb5735fe49db625b4)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:06.900054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5e9dea38-1cfb-4038-953b-912ffb9ef63e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 18 12:37:06.900349 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9dea38-1cfb-4038-953b-912ffb9ef63e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:06.904696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 2/5] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:06 2022] GET /identity/v3/projects/efd990fcb71545ffb5735fe49db625b4 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:08.903994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfbe46-677e-470d-be76-c6d38b01ab00 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:08.904517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfbe46-677e-470d-be76-c6d38b01ab00 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:08.904624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfbe46-677e-470d-be76-c6d38b01ab00 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:08.909050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 4/6] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:08.914674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea730d-7f3a-4c71-a7e8-28fcc158df11 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:08.915336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea730d-7f3a-4c71-a7e8-28fcc158df11 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:08.915556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea730d-7f3a-4c71-a7e8-28fcc158df11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:08.938476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d2ea730d-7f3a-4c71-a7e8-28fcc158df11 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:08.940648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d2ea730d-7f3a-4c71-a7e8-28fcc158df11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:08.952106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 3/7] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:37:08.974770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfbe46-677e-470d-be76-c6d38b01ab00 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:08.986417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfbe46-677e-470d-be76-c6d38b01ab00 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:08.990326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7a11-ad9c-43ea-ac87-c45ffbf10165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:08.990897 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7a11-ad9c-43ea-ac87-c45ffbf10165 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:08.991190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7a11-ad9c-43ea-ac87-c45ffbf10165 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:08.991552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7a11-ad9c-43ea-ac87-c45ffbf10165 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:08.999347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7a11-ad9c-43ea-ac87-c45ffbf10165 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:09.028535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7a11-ad9c-43ea-ac87-c45ffbf10165 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:09.037174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 5/8] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:08 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:09.043151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea730d-7f3a-4c71-a7e8-28fcc158df11 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:09.051932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea730d-7f3a-4c71-a7e8-28fcc158df11 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:09.056102 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc2fba-7c34-48f0-be7e-64fcf1ea8a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:09.056930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc2fba-7c34-48f0-be7e-64fcf1ea8a32 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:09.057221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc2fba-7c34-48f0-be7e-64fcf1ea8a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:09.057504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc2fba-7c34-48f0-be7e-64fcf1ea8a32 admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:09.058730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc2fba-7c34-48f0-be7e-64fcf1ea8a32 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:09.087524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc2fba-7c34-48f0-be7e-64fcf1ea8a32 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:09.089024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 4/9] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:09 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:11.049135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398267-a373-4299-8d02-c91e6aed6f4e None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:11.049660 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398267-a373-4299-8d02-c91e6aed6f4e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:11.049743 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0398267-a373-4299-8d02-c91e6aed6f4e None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:11.051390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 6/10] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 12:37:11.056517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af113439-815f-49e0-b6ce-d2e03018400e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:11.056944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af113439-815f-49e0-b6ce-d2e03018400e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:11.057093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af113439-815f-49e0-b6ce-d2e03018400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:11.078863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-af113439-815f-49e0-b6ce-d2e03018400e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:11.080868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-af113439-815f-49e0-b6ce-d2e03018400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:11.087610 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 5/11] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:11 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:11.110046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0398267-a373-4299-8d02-c91e6aed6f4e None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:11.121949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0398267-a373-4299-8d02-c91e6aed6f4e None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:11.125733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09216953-8fc2-49ec-8f69-1a34ea40db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:11.126979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09216953-8fc2-49ec-8f69-1a34ea40db38 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:11.127265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09216953-8fc2-49ec-8f69-1a34ea40db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:11.127575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09216953-8fc2-49ec-8f69-1a34ea40db38 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:11.140066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09216953-8fc2-49ec-8f69-1a34ea40db38 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:11.147280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-09216953-8fc2-49ec-8f69-1a34ea40db38 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:37:11.148399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 7/12] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:37:11.153917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af113439-815f-49e0-b6ce-d2e03018400e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:11.162473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af113439-815f-49e0-b6ce-d2e03018400e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:11.166762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:11.167393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:11.167691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:11.167981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:11.168698 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:11.169002 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:11.194904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:11.194904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:37:11.194904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:37:11.196054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:11.208288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 6/13] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:11.213794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09216953-8fc2-49ec-8f69-1a34ea40db38 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:11.223700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09216953-8fc2-49ec-8f69-1a34ea40db38 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:11.227867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc27c1-0b4d-408f-87e7-303cdc330fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:11.228653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc27c1-0b4d-408f-87e7-303cdc330fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:11.228944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc27c1-0b4d-408f-87e7-303cdc330fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:11.229229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc27c1-0b4d-408f-87e7-303cdc330fc0 admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:11.230757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc27c1-0b4d-408f-87e7-303cdc330fc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:11.256734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc27c1-0b4d-408f-87e7-303cdc330fc0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:11.258998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 8/14] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:11 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:11.264362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:11.274537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2e08a-a4d3-4d0b-889c-1455e764ce92 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:11.278450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fd42b-a4bf-4b9c-8af5-5da928b59e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:11.279163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fd42b-a4bf-4b9c-8af5-5da928b59e34 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:11.279478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fd42b-a4bf-4b9c-8af5-5da928b59e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:11.279757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fd42b-a4bf-4b9c-8af5-5da928b59e34 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:11.280822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fd42b-a4bf-4b9c-8af5-5da928b59e34 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:11.306269 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fd42b-a4bf-4b9c-8af5-5da928b59e34 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:11.307669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 7/15] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:37:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:11.313114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc27c1-0b4d-408f-87e7-303cdc330fc0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:11.323050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc27c1-0b4d-408f-87e7-303cdc330fc0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:11.327071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff3965-555a-41a5-ba7c-ff1f07774af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:11.327790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff3965-555a-41a5-ba7c-ff1f07774af2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:11.328084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff3965-555a-41a5-ba7c-ff1f07774af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:11.328370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff3965-555a-41a5-ba7c-ff1f07774af2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:11.329139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff3965-555a-41a5-ba7c-ff1f07774af2 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.domain.id=default, user.id=4b6ba909638e4d95a0827152d2079014) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:11.330147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff3965-555a-41a5-ba7c-ff1f07774af2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:11.355282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-c1ff3965-555a-41a5-ba7c-ff1f07774af2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:11.355282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:37:11.355282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:37:11.356479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff3965-555a-41a5-ba7c-ff1f07774af2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:11.363635 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 9/16] 10.222.0.87 () {56 vars in 1343 bytes} [Tue Jan 18 12:37:11 2022] GET /identity/v3/role_assignments?user.id=4b6ba909638e4d95a0827152d2079014&scope.domain.id=default&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 233 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:13.327749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad99f-3d96-4e4f-a2a6-473d87c07413 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:13.328276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad99f-3d96-4e4f-a2a6-473d87c07413 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:13.328375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad99f-3d96-4e4f-a2a6-473d87c07413 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:13.330514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 8/17] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:13.335795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7dfdb-e1b4-4203-bbfe-a97afda3b9e1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:13.336259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7dfdb-e1b4-4203-bbfe-a97afda3b9e1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:13.336353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7dfdb-e1b4-4203-bbfe-a97afda3b9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:13.369980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG passlib.handlers.bcrypt [None req-3ad7dfdb-e1b4-4203-bbfe-a97afda3b9e1 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=66302) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Jan 18 12:37:13.370397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG passlib.handlers.bcrypt [None req-3ad7dfdb-e1b4-4203-bbfe-a97afda3b9e1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=66302) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Jan 18 12:37:13.417987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-3ad7dfdb-e1b4-4203-bbfe-a97afda3b9e1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:13.419583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3ad7dfdb-e1b4-4203-bbfe-a97afda3b9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:13.427295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 10/18] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:13 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:13.448786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad99f-3d96-4e4f-a2a6-473d87c07413 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:13.460536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad99f-3d96-4e4f-a2a6-473d87c07413 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:13.464390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed006be-a6e6-4904-a887-8d19a3ab5d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:13.465210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed006be-a6e6-4904-a887-8d19a3ab5d85 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:13.465503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed006be-a6e6-4904-a887-8d19a3ab5d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:13.465785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed006be-a6e6-4904-a887-8d19a3ab5d85 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:13.477765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed006be-a6e6-4904-a887-8d19a3ab5d85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:13.484152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-1ed006be-a6e6-4904-a887-8d19a3ab5d85 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:37:13.485257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 9/19] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:37:13.491471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7dfdb-e1b4-4203-bbfe-a97afda3b9e1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:13.500004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7dfdb-e1b4-4203-bbfe-a97afda3b9e1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:13.504217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:13.504811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:13.505130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:13.505417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:13.506109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:13.506410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:13.531405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:13.531405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:37:13.531405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:37:13.532327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:13.543185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 11/20] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:13.549524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed006be-a6e6-4904-a887-8d19a3ab5d85 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:13.559587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed006be-a6e6-4904-a887-8d19a3ab5d85 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:13.563574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece680a-e8e2-4593-98b3-5cdc3224c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:13.564397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece680a-e8e2-4593-98b3-5cdc3224c515 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:13.564683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece680a-e8e2-4593-98b3-5cdc3224c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:13.564963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece680a-e8e2-4593-98b3-5cdc3224c515 admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:13.566056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece680a-e8e2-4593-98b3-5cdc3224c515 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:13.591164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece680a-e8e2-4593-98b3-5cdc3224c515 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:13.592543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 10/21] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:13 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:13.598229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:13.607597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3a5b9-0edf-4b89-b92f-105c1aba4587 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:13.612324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adddf3b-035c-4eb3-9b70-e652f470e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:13.613036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adddf3b-035c-4eb3-9b70-e652f470e154 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:13.613326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adddf3b-035c-4eb3-9b70-e652f470e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:13.613606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adddf3b-035c-4eb3-9b70-e652f470e154 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:13.614840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adddf3b-035c-4eb3-9b70-e652f470e154 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:13.640222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adddf3b-035c-4eb3-9b70-e652f470e154 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:13.641652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 12/22] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:37:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:13.646977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece680a-e8e2-4593-98b3-5cdc3224c515 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:13.656583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece680a-e8e2-4593-98b3-5cdc3224c515 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:13.661251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538248d-93e3-4dce-9aca-93c293e72709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:13.662040 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538248d-93e3-4dce-9aca-93c293e72709 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:13.662331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538248d-93e3-4dce-9aca-93c293e72709 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:13.662633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538248d-93e3-4dce-9aca-93c293e72709 admin admin] PATH_INFO: `/v3/domains/default/users/4b6ba909638e4d95a0827152d2079014/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:13.664470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538248d-93e3-4dce-9aca-93c293e72709 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4b6ba909638e4d95a0827152d2079014, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:13.689913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-2538248d-93e3-4dce-9aca-93c293e72709 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:13.689913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:37:13.689913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:37:13.691942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538248d-93e3-4dce-9aca-93c293e72709 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:13.976867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 11/23] 10.222.0.87 () {58 vars in 1382 bytes} [Tue Jan 18 12:37:13 2022] PUT /identity/v3/domains/default/users/4b6ba909638e4d95a0827152d2079014/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:37:15.958065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c924-b1a4-465d-a786-6fe7e28f8214 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:15.958611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c924-b1a4-465d-a786-6fe7e28f8214 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:15.958611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394c924-b1a4-465d-a786-6fe7e28f8214 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:15.960361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 13/24] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:15.966322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7609-8bbc-4182-85c3-7af8869afc67 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:15.966717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7609-8bbc-4182-85c3-7af8869afc67 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:15.966904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c7609-8bbc-4182-85c3-7af8869afc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:15.991960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-9a2c7609-8bbc-4182-85c3-7af8869afc67 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:15.993422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9a2c7609-8bbc-4182-85c3-7af8869afc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:16.058611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 12/25] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:16.081339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c924-b1a4-465d-a786-6fe7e28f8214 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:16.093421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394c924-b1a4-465d-a786-6fe7e28f8214 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:16.098029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea944-748c-452c-9653-cd033189f23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:16.098749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea944-748c-452c-9653-cd033189f23a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:16.099040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea944-748c-452c-9653-cd033189f23a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:16.099357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea944-748c-452c-9653-cd033189f23a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:16.111738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ea944-748c-452c-9653-cd033189f23a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:16.117929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-3d5ea944-748c-452c-9653-cd033189f23a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:37:16.119021 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 14/26] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:37:16.124801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7609-8bbc-4182-85c3-7af8869afc67 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:16.133675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c7609-8bbc-4182-85c3-7af8869afc67 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:16.137667 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7a9e-45f2-4781-845f-a46ac6a1d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:16.138265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7a9e-45f2-4781-845f-a46ac6a1d4fa admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:16.138556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7a9e-45f2-4781-845f-a46ac6a1d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:16.138844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd7a9e-45f2-4781-845f-a46ac6a1d4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:16.139684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd7a9e-45f2-4781-845f-a46ac6a1d4fa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:16.139988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd7a9e-45f2-4781-845f-a46ac6a1d4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:16.167046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd7a9e-45f2-4781-845f-a46ac6a1d4fa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:16.178505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 13/27] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:16.184080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea944-748c-452c-9653-cd033189f23a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:16.194222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea944-748c-452c-9653-cd033189f23a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:16.198256 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f86a-919c-4b93-accb-0482ef0d7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:16.199045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f86a-919c-4b93-accb-0482ef0d7636 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:16.199372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f86a-919c-4b93-accb-0482ef0d7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:16.199664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f86a-919c-4b93-accb-0482ef0d7636 admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:16.200773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f86a-919c-4b93-accb-0482ef0d7636 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:16.228060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f86a-919c-4b93-accb-0482ef0d7636 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:16.229459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 15/28] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:16 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:16.234690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7a9e-45f2-4781-845f-a46ac6a1d4fa admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:16.244023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd7a9e-45f2-4781-845f-a46ac6a1d4fa admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:16.248033 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a7473-857c-40d5-b11e-ff1e9852e6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:16.248746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7473-857c-40d5-b11e-ff1e9852e6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:16.249033 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7473-857c-40d5-b11e-ff1e9852e6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:16.249319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a7473-857c-40d5-b11e-ff1e9852e6b8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:16.250541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a7473-857c-40d5-b11e-ff1e9852e6b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:16.276258 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a7473-857c-40d5-b11e-ff1e9852e6b8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:16.277725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 14/29] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:37:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:16.283906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f86a-919c-4b93-accb-0482ef0d7636 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:16.293489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f86a-919c-4b93-accb-0482ef0d7636 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:16.297564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a0e6b-2eaf-43df-8878-e0344225a0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:16.298637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a0e6b-2eaf-43df-8878-e0344225a0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:16.298936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a0e6b-2eaf-43df-8878-e0344225a0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:16.299227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a0e6b-2eaf-43df-8878-e0344225a0b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:16.300046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a0e6b-2eaf-43df-8878-e0344225a0b2 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.domain.id=default, user.id=4b6ba909638e4d95a0827152d2079014) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:16.300380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a0e6b-2eaf-43df-8878-e0344225a0b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:16.325780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a0e6b-2eaf-43df-8878-e0344225a0b2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:16.332607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 16/30] 10.222.0.87 () {56 vars in 1343 bytes} [Tue Jan 18 12:37:16 2022] GET /identity/v3/role_assignments?user.id=4b6ba909638e4d95a0827152d2079014&scope.domain.id=default&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 530 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:18.416365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56650608-a9de-4cd5-92c5-04b3cf962671 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:18.416865 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56650608-a9de-4cd5-92c5-04b3cf962671 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:18.417012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56650608-a9de-4cd5-92c5-04b3cf962671 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:18.418652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 15/31] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:18.427557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb46c5-1c55-4d2f-90ba-e8c2c4bf5668 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:18.428027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb46c5-1c55-4d2f-90ba-e8c2c4bf5668 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:18.428141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb46c5-1c55-4d2f-90ba-e8c2c4bf5668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:18.468097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-92bb46c5-1c55-4d2f-90ba-e8c2c4bf5668 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:18.469267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-92bb46c5-1c55-4d2f-90ba-e8c2c4bf5668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:18.477143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 17/32] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:18 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:18.502871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56650608-a9de-4cd5-92c5-04b3cf962671 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:18.515180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56650608-a9de-4cd5-92c5-04b3cf962671 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:18.520284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279a260-9093-4eb0-a7a6-39295efb6343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:18.520866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a260-9093-4eb0-a7a6-39295efb6343 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:18.521162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a260-9093-4eb0-a7a6-39295efb6343 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:18.521451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279a260-9093-4eb0-a7a6-39295efb6343 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:18.529281 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279a260-9093-4eb0-a7a6-39295efb6343 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:18.556350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279a260-9093-4eb0-a7a6-39295efb6343 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:18.565914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 16/33] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:18 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:18.571604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb46c5-1c55-4d2f-90ba-e8c2c4bf5668 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:18.581180 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb46c5-1c55-4d2f-90ba-e8c2c4bf5668 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:18.585242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f525c-c374-4d8b-9f1e-6226acc80cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:18.585967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f525c-c374-4d8b-9f1e-6226acc80cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:18.586261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f525c-c374-4d8b-9f1e-6226acc80cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:18.586547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f525c-c374-4d8b-9f1e-6226acc80cb0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:18.587651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f525c-c374-4d8b-9f1e-6226acc80cb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:18.614148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f525c-c374-4d8b-9f1e-6226acc80cb0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:18.615640 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 18/34] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:37:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:20.586744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e27b2f-d6f2-4f97-918f-40d5a6e096fe None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:20.587288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e27b2f-d6f2-4f97-918f-40d5a6e096fe None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:20.587404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e27b2f-d6f2-4f97-918f-40d5a6e096fe None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:20.589039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 17/35] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:20.594074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819b923-7ee3-4497-80ed-949b26e98aa9 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:20.594540 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819b923-7ee3-4497-80ed-949b26e98aa9 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:20.595533 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819b923-7ee3-4497-80ed-949b26e98aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:20.617501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e819b923-7ee3-4497-80ed-949b26e98aa9 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:20.618668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e819b923-7ee3-4497-80ed-949b26e98aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:20.625353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 19/36] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:20.648416 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e27b2f-d6f2-4f97-918f-40d5a6e096fe None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:20.660836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e27b2f-d6f2-4f97-918f-40d5a6e096fe None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:20.665005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5c058-6150-4c51-86c0-9d012cc735bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:20.665728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c058-6150-4c51-86c0-9d012cc735bc admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:20.666022 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c058-6150-4c51-86c0-9d012cc735bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:20.666311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5c058-6150-4c51-86c0-9d012cc735bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:20.678162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5c058-6150-4c51-86c0-9d012cc735bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:20.703519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5c058-6150-4c51-86c0-9d012cc735bc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:20.721787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-ead5c058-6150-4c51-86c0-9d012cc735bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:37:20.722884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 18/37] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:37:20.728730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819b923-7ee3-4497-80ed-949b26e98aa9 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:20.737746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819b923-7ee3-4497-80ed-949b26e98aa9 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:20.741725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637a4fd-9365-494d-8dc0-a00e8adb5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:20.742314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637a4fd-9365-494d-8dc0-a00e8adb5a96 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:20.742610 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637a4fd-9365-494d-8dc0-a00e8adb5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:20.742898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637a4fd-9365-494d-8dc0-a00e8adb5a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:20.743614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637a4fd-9365-494d-8dc0-a00e8adb5a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:20.743917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637a4fd-9365-494d-8dc0-a00e8adb5a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:20.769958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-7637a4fd-9365-494d-8dc0-a00e8adb5a96 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:20.769958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:37:20.769958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:37:20.770868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637a4fd-9365-494d-8dc0-a00e8adb5a96 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:20.787684 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 20/38] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:20.793650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5c058-6150-4c51-86c0-9d012cc735bc admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:20.802937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5c058-6150-4c51-86c0-9d012cc735bc admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:20.806873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb315-cba7-4220-9853-92c729a7c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:20.807496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb315-cba7-4220-9853-92c729a7c1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:20.807785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb315-cba7-4220-9853-92c729a7c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:20.808067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb315-cba7-4220-9853-92c729a7c1b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:20.808728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb315-cba7-4220-9853-92c729a7c1b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:20.835487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-0e2cb315-cba7-4220-9853-92c729a7c1b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:20.835487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:37:20.835487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:37:20.836718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb315-cba7-4220-9853-92c729a7c1b2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:20.907091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 19/39] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:37:20 2022] POST /identity/v3/projects => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:37:22.875339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1065b2b-10c9-4f1a-b649-d3ef08857852 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:22.875928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1065b2b-10c9-4f1a-b649-d3ef08857852 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:22.876049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1065b2b-10c9-4f1a-b649-d3ef08857852 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:22.877663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 21/40] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:22.882834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfea8c-a318-4318-b35e-0eecac216d9c None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:22.883259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfea8c-a318-4318-b35e-0eecac216d9c None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:22.883451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfea8c-a318-4318-b35e-0eecac216d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:22.906191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b5bfea8c-a318-4318-b35e-0eecac216d9c None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:22.908579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b5bfea8c-a318-4318-b35e-0eecac216d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:22.973475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 20/41] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:22.995064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1065b2b-10c9-4f1a-b649-d3ef08857852 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:23.006770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1065b2b-10c9-4f1a-b649-d3ef08857852 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:23.010624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088bf7a2-5c4f-4a96-b05b-9b021eb80f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:23.011210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bf7a2-5c4f-4a96-b05b-9b021eb80f5f admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:23.011527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bf7a2-5c4f-4a96-b05b-9b021eb80f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:23.011810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088bf7a2-5c4f-4a96-b05b-9b021eb80f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:23.012505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bf7a2-5c4f-4a96-b05b-9b021eb80f5f admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:23.038363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-088bf7a2-5c4f-4a96-b05b-9b021eb80f5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:23.038363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:37:23.038363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:37:23.039552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088bf7a2-5c4f-4a96-b05b-9b021eb80f5f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:23.344571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 22/42] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 12:37:22 2022] POST /identity/v3/roles => generated 219 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:37:25.341695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cfc57-97db-47ea-be5d-3e82fa409f9d None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:25.342199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cfc57-97db-47ea-be5d-3e82fa409f9d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:25.342199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cfc57-97db-47ea-be5d-3e82fa409f9d None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:25.343897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 21/43] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:25.350135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72a486-32c9-4582-8c26-e04ccf0328bc None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:25.350556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72a486-32c9-4582-8c26-e04ccf0328bc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:25.350714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72a486-32c9-4582-8c26-e04ccf0328bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:25.373568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-ff72a486-32c9-4582-8c26-e04ccf0328bc None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:25.375015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ff72a486-32c9-4582-8c26-e04ccf0328bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:25.382772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 23/44] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:25 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:37:25.405485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cfc57-97db-47ea-be5d-3e82fa409f9d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:25.417665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cfc57-97db-47ea-be5d-3e82fa409f9d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:25.421489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cdbe4-eeb0-4453-abd0-d8af6e4bd0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:25.422079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cdbe4-eeb0-4453-abd0-d8af6e4bd0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:25.422406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cdbe4-eeb0-4453-abd0-d8af6e4bd0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:25.422688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cdbe4-eeb0-4453-abd0-d8af6e4bd0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:25.423411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cdbe4-eeb0-4453-abd0-d8af6e4bd0d3 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:25.448624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-0d3cdbe4-eeb0-4453-abd0-d8af6e4bd0d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:25.448624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:37:25.448624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:37:25.449533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cdbe4-eeb0-4453-abd0-d8af6e4bd0d3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:25.558149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 22/45] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 12:37:25 2022] POST /identity/v3/roles => generated 225 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:37:27.546308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e28f26-d3bc-402e-ae28-149bea34c1ca None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:27.546830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e28f26-d3bc-402e-ae28-149bea34c1ca None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:27.547298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e28f26-d3bc-402e-ae28-149bea34c1ca None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:27.549168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 24/46] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:27.554500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8b0a-5f62-411a-a354-f6a2d4271337 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:27.554928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8b0a-5f62-411a-a354-f6a2d4271337 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:27.555081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f8b0a-5f62-411a-a354-f6a2d4271337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:27.577330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-945f8b0a-5f62-411a-a354-f6a2d4271337 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:27.578463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-945f8b0a-5f62-411a-a354-f6a2d4271337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:27.585841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 23/47] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:27.608655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e28f26-d3bc-402e-ae28-149bea34c1ca None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:27.620828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e28f26-d3bc-402e-ae28-149bea34c1ca None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:27.624697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd423f1-30e9-42e7-b80e-8655f7acd5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:27.625290 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd423f1-30e9-42e7-b80e-8655f7acd5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:27.625583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd423f1-30e9-42e7-b80e-8655f7acd5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:27.626946 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd423f1-30e9-42e7-b80e-8655f7acd5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:27.627703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd423f1-30e9-42e7-b80e-8655f7acd5b3 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:27.654465 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd423f1-30e9-42e7-b80e-8655f7acd5b3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:27.786681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 25/48] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 12:37:27 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:37:29.761304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b9652-54ad-4fea-a8ae-27366d6eec6d None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:29.761835 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b9652-54ad-4fea-a8ae-27366d6eec6d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:29.761921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b9652-54ad-4fea-a8ae-27366d6eec6d None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:29.763604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 24/49] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:29.769258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9d4d1-b5f2-4ee7-93ef-cfc25afb2cb0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:29.769696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9d4d1-b5f2-4ee7-93ef-cfc25afb2cb0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:29.769824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9d4d1-b5f2-4ee7-93ef-cfc25afb2cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:29.792644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f0c9d4d1-b5f2-4ee7-93ef-cfc25afb2cb0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:29.793757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f0c9d4d1-b5f2-4ee7-93ef-cfc25afb2cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:29.800449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 26/50] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:29.821981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b9652-54ad-4fea-a8ae-27366d6eec6d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:29.834641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b9652-54ad-4fea-a8ae-27366d6eec6d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:29.838495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1d9d2-525a-4202-b6b9-c5156768a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:29.839212 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1d9d2-525a-4202-b6b9-c5156768a959 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:29.839543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1d9d2-525a-4202-b6b9-c5156768a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:29.839834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1d9d2-525a-4202-b6b9-c5156768a959 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:29.840938 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1d9d2-525a-4202-b6b9-c5156768a959 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:29.867942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1d9d2-525a-4202-b6b9-c5156768a959 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:29.869408 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 25/51] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:37:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:29.874839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9d4d1-b5f2-4ee7-93ef-cfc25afb2cb0 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:29.883952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9d4d1-b5f2-4ee7-93ef-cfc25afb2cb0 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:29.887878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827737a-20ed-4018-9a75-e7df96fd5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:29.888461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827737a-20ed-4018-9a75-e7df96fd5c54 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:29.888756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827737a-20ed-4018-9a75-e7df96fd5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:29.889043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827737a-20ed-4018-9a75-e7df96fd5c54 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:29.889856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827737a-20ed-4018-9a75-e7df96fd5c54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:29.915000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-b827737a-20ed-4018-9a75-e7df96fd5c54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:29.915000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:37:29.915000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:37:29.916228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827737a-20ed-4018-9a75-e7df96fd5c54 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:30.031758 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 27/52] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:37:29 2022] POST /identity/v3/projects => generated 312 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:37:31.994491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b72bf7-fd86-4c68-bfc3-a28256aa3119 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:31.995073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b72bf7-fd86-4c68-bfc3-a28256aa3119 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:31.995073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b72bf7-fd86-4c68-bfc3-a28256aa3119 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:31.996807 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 26/53] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:32.002812 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08623a94-af0a-4667-ace9-fea33159f217 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:32.003216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08623a94-af0a-4667-ace9-fea33159f217 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:32.003430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08623a94-af0a-4667-ace9-fea33159f217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:32.025459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-08623a94-af0a-4667-ace9-fea33159f217 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:32.026586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-08623a94-af0a-4667-ace9-fea33159f217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:32.095714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 28/54] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:32.121535 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b72bf7-fd86-4c68-bfc3-a28256aa3119 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:32.138913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b72bf7-fd86-4c68-bfc3-a28256aa3119 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:32.142861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c0e79-271a-499d-8818-e17906bcd58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:32.143612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c0e79-271a-499d-8818-e17906bcd58d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:32.143909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c0e79-271a-499d-8818-e17906bcd58d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:32.144198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c0e79-271a-499d-8818-e17906bcd58d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:32.145269 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c0e79-271a-499d-8818-e17906bcd58d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:32.171428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c0e79-271a-499d-8818-e17906bcd58d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:32.173573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 27/55] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:37:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:32.179335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08623a94-af0a-4667-ace9-fea33159f217 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:32.187994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08623a94-af0a-4667-ace9-fea33159f217 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:32.192074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16450b-8e9b-40f0-a2ac-fecb3eafb743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:32.192662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16450b-8e9b-40f0-a2ac-fecb3eafb743 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:32.192956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16450b-8e9b-40f0-a2ac-fecb3eafb743 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:32.193243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16450b-8e9b-40f0-a2ac-fecb3eafb743 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:32.193903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16450b-8e9b-40f0-a2ac-fecb3eafb743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:32.220219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16450b-8e9b-40f0-a2ac-fecb3eafb743 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:32.352415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 29/56] 10.222.0.87 () {60 vars in 1161 bytes} [Tue Jan 18 12:37:32 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:37:34.354454 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787a422-c01a-4ddd-b977-bff3a8863c41 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:34.354950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787a422-c01a-4ddd-b977-bff3a8863c41 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:34.354950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787a422-c01a-4ddd-b977-bff3a8863c41 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:34.356705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 28/57] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:34.361697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed380273-1f9d-4773-81f3-21f40662ddac None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:34.362106 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed380273-1f9d-4773-81f3-21f40662ddac None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:34.362270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed380273-1f9d-4773-81f3-21f40662ddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:34.384422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-ed380273-1f9d-4773-81f3-21f40662ddac None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:34.385618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ed380273-1f9d-4773-81f3-21f40662ddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:34.451031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 30/58] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:34.474617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787a422-c01a-4ddd-b977-bff3a8863c41 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:34.486195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787a422-c01a-4ddd-b977-bff3a8863c41 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:34.489980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e58606-24a5-4e8a-b33e-034e482b9ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:34.490699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58606-24a5-4e8a-b33e-034e482b9ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:34.490993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58606-24a5-4e8a-b33e-034e482b9ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:34.491280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e58606-24a5-4e8a-b33e-034e482b9ef7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:34.492379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58606-24a5-4e8a-b33e-034e482b9ef7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:34.518858 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e58606-24a5-4e8a-b33e-034e482b9ef7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:34.520414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 29/59] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:37:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:34.526034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed380273-1f9d-4773-81f3-21f40662ddac None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:34.535596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed380273-1f9d-4773-81f3-21f40662ddac None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:34.539972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ab7b1-34a0-4665-ab0e-ca36f44ef844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:34.540584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab7b1-34a0-4665-ab0e-ca36f44ef844 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:34.540882 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab7b1-34a0-4665-ab0e-ca36f44ef844 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:34.541172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ab7b1-34a0-4665-ab0e-ca36f44ef844 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:34.541849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ab7b1-34a0-4665-ab0e-ca36f44ef844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:34.567438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-c57ab7b1-34a0-4665-ab0e-ca36f44ef844 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:34.567438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:37:34.567438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:37:34.568686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ab7b1-34a0-4665-ab0e-ca36f44ef844 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:34.653194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 31/60] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:37:34 2022] POST /identity/v3/users => generated 275 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:37:36.646057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725d6a3-1a8d-4c8c-87e9-cbd1d5878aac None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:36.646672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725d6a3-1a8d-4c8c-87e9-cbd1d5878aac None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:36.646672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725d6a3-1a8d-4c8c-87e9-cbd1d5878aac None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:36.648414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 30/61] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:36.653419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ea30d-96ae-47e4-bde3-7d6a3eb8fd3c None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:36.653821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ea30d-96ae-47e4-bde3-7d6a3eb8fd3c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:36.654008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ea30d-96ae-47e4-bde3-7d6a3eb8fd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:36.677866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-138ea30d-96ae-47e4-bde3-7d6a3eb8fd3c None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:36.678991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-138ea30d-96ae-47e4-bde3-7d6a3eb8fd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:36.685710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 32/62] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:36.707700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725d6a3-1a8d-4c8c-87e9-cbd1d5878aac None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:36.719905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725d6a3-1a8d-4c8c-87e9-cbd1d5878aac None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:36.723765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5503f5-06a6-4151-8126-6be926ccab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:36.724478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5503f5-06a6-4151-8126-6be926ccab2b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:36.724765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5503f5-06a6-4151-8126-6be926ccab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:36.725054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5503f5-06a6-4151-8126-6be926ccab2b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:36.737233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5503f5-06a6-4151-8126-6be926ccab2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:36.743476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-5b5503f5-06a6-4151-8126-6be926ccab2b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:37:36.744548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 31/63] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:37:36.750571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ea30d-96ae-47e4-bde3-7d6a3eb8fd3c None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:36.759126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ea30d-96ae-47e4-bde3-7d6a3eb8fd3c None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:36.763082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe60f45-ca62-4d43-9c28-f0c595bff557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:36.763704 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60f45-ca62-4d43-9c28-f0c595bff557 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:36.763999 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60f45-ca62-4d43-9c28-f0c595bff557 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:36.764286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe60f45-ca62-4d43-9c28-f0c595bff557 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:36.765002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe60f45-ca62-4d43-9c28-f0c595bff557 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:36.765309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe60f45-ca62-4d43-9c28-f0c595bff557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:36.791588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe60f45-ca62-4d43-9c28-f0c595bff557 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:36.800878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 33/64] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:37:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:36.806419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5503f5-06a6-4151-8126-6be926ccab2b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:36.816743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5503f5-06a6-4151-8126-6be926ccab2b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:36.820637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538ee6b-ebe8-4a5c-b7b9-b7f1024ae140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:36.821424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538ee6b-ebe8-4a5c-b7b9-b7f1024ae140 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:36.821712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538ee6b-ebe8-4a5c-b7b9-b7f1024ae140 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:36.822106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538ee6b-ebe8-4a5c-b7b9-b7f1024ae140 admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:36.840156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538ee6b-ebe8-4a5c-b7b9-b7f1024ae140 admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:36.866983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538ee6b-ebe8-4a5c-b7b9-b7f1024ae140 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:36.868512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 32/65] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:36 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:36.873877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe60f45-ca62-4d43-9c28-f0c595bff557 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:36.883170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe60f45-ca62-4d43-9c28-f0c595bff557 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:36.887130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fd8fb-37c1-474a-bc89-b2e47ebc5f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:36.887740 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fd8fb-37c1-474a-bc89-b2e47ebc5f25 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:36.888037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fd8fb-37c1-474a-bc89-b2e47ebc5f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:36.888325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fd8fb-37c1-474a-bc89-b2e47ebc5f25 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:36.895877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fd8fb-37c1-474a-bc89-b2e47ebc5f25 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:36.922175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fd8fb-37c1-474a-bc89-b2e47ebc5f25 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:36.931403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 34/66] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:36 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:36.936749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538ee6b-ebe8-4a5c-b7b9-b7f1024ae140 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:36.946030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538ee6b-ebe8-4a5c-b7b9-b7f1024ae140 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:36.950037 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe65da-814c-4354-8fef-ab145a7ae766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:36.950804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe65da-814c-4354-8fef-ab145a7ae766 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:36.951096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe65da-814c-4354-8fef-ab145a7ae766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:36.951415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe65da-814c-4354-8fef-ab145a7ae766 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:36.952501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe65da-814c-4354-8fef-ab145a7ae766 admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:36.978551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe65da-814c-4354-8fef-ab145a7ae766 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:36.980104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 33/67] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:36 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:37:36.986616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fd8fb-37c1-474a-bc89-b2e47ebc5f25 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:36.995226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fd8fb-37c1-474a-bc89-b2e47ebc5f25 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:36.999403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d12f4c-88e4-4984-a53e-f9b4100e8bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:36.999980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d12f4c-88e4-4984-a53e-f9b4100e8bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:37.000764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d12f4c-88e4-4984-a53e-f9b4100e8bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:37.001090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d12f4c-88e4-4984-a53e-f9b4100e8bd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:37.001903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d12f4c-88e4-4984-a53e-f9b4100e8bd4 admin admin] RBAC: Adding query filter params (role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=6989cbd135d744de861fa22cace1177a, user.id=c143e78768494434979863997771120b) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:37.002216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d12f4c-88e4-4984-a53e-f9b4100e8bd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:37.033183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d12f4c-88e4-4984-a53e-f9b4100e8bd4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:37.039440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 35/68] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:37:36 2022] GET /identity/v3/role_assignments?user.id=c143e78768494434979863997771120b&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:39.024519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089170f-c64c-40e5-8ba5-a9e367416d82 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:39.025074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089170f-c64c-40e5-8ba5-a9e367416d82 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:39.025074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8089170f-c64c-40e5-8ba5-a9e367416d82 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:39.026766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 34/69] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:39.032274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35a628-9c9f-4f59-aee7-eef001470d2d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:39.032710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35a628-9c9f-4f59-aee7-eef001470d2d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:39.032851 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35a628-9c9f-4f59-aee7-eef001470d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:39.066657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-6c35a628-9c9f-4f59-aee7-eef001470d2d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:39.067857 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-6c35a628-9c9f-4f59-aee7-eef001470d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:39.075019 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 36/70] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:39 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:39.098401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089170f-c64c-40e5-8ba5-a9e367416d82 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:39.111034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8089170f-c64c-40e5-8ba5-a9e367416d82 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:39.114902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa0e3c-f163-416d-a7bf-4df1fd095c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:39.115659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa0e3c-f163-416d-a7bf-4df1fd095c9a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:39.115957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa0e3c-f163-416d-a7bf-4df1fd095c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:39.116247 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa0e3c-f163-416d-a7bf-4df1fd095c9a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:39.127762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa0e3c-f163-416d-a7bf-4df1fd095c9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:39.134078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-66fa0e3c-f163-416d-a7bf-4df1fd095c9a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:37:39.135217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 35/71] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:37:39.141228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35a628-9c9f-4f59-aee7-eef001470d2d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:39.150008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35a628-9c9f-4f59-aee7-eef001470d2d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:39.154049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea096-73b9-430a-84bc-0479169a3d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:39.154650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea096-73b9-430a-84bc-0479169a3d92 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:39.154945 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea096-73b9-430a-84bc-0479169a3d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:39.155229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ea096-73b9-430a-84bc-0479169a3d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:39.155967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea096-73b9-430a-84bc-0479169a3d92 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:39.156270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea096-73b9-430a-84bc-0479169a3d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:39.187410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ea096-73b9-430a-84bc-0479169a3d92 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:39.196993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 37/72] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:37:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:37:39.202707 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa0e3c-f163-416d-a7bf-4df1fd095c9a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:39.216710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa0e3c-f163-416d-a7bf-4df1fd095c9a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:39.222037 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e0333-033c-476c-b284-b4c83485baf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:39.222846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e0333-033c-476c-b284-b4c83485baf9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:39.223133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e0333-033c-476c-b284-b4c83485baf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:39.223450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e0333-033c-476c-b284-b4c83485baf9 admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:39.224562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e0333-033c-476c-b284-b4c83485baf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:39.250433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e0333-033c-476c-b284-b4c83485baf9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:39.252001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 36/73] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:39 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:39.257526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea096-73b9-430a-84bc-0479169a3d92 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:39.267581 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ea096-73b9-430a-84bc-0479169a3d92 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:39.271598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae62741-2335-4b91-9679-67f11bca3be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:39.272379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae62741-2335-4b91-9679-67f11bca3be2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:39.272676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae62741-2335-4b91-9679-67f11bca3be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:39.272967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae62741-2335-4b91-9679-67f11bca3be2 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:39.274090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae62741-2335-4b91-9679-67f11bca3be2 admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:39.302371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae62741-2335-4b91-9679-67f11bca3be2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:39.303911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 38/74] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:39 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:39.309537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e0333-033c-476c-b284-b4c83485baf9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:39.322316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e0333-033c-476c-b284-b4c83485baf9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:39.326488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de139c6-166a-403f-90ce-fd1d3480f445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:39.327300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de139c6-166a-403f-90ce-fd1d3480f445 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:39.327624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de139c6-166a-403f-90ce-fd1d3480f445 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:39.327907 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de139c6-166a-403f-90ce-fd1d3480f445 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a/users/c143e78768494434979863997771120b/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:39.329932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de139c6-166a-403f-90ce-fd1d3480f445 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6989cbd135d744de861fa22cace1177a, user_id=c143e78768494434979863997771120b, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:39.356411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de139c6-166a-403f-90ce-fd1d3480f445 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:39.470087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 37/75] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:37:39 2022] PUT /identity/v3/projects/6989cbd135d744de861fa22cace1177a/users/c143e78768494434979863997771120b/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:37:41.459363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8ab75-e03e-492c-82f3-3db9456a8881 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:41.459879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8ab75-e03e-492c-82f3-3db9456a8881 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:41.459971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8ab75-e03e-492c-82f3-3db9456a8881 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:41.461909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 39/76] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:41.467422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb51e-e6de-48f5-9eff-2c3e488d5a11 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:41.467949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb51e-e6de-48f5-9eff-2c3e488d5a11 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:41.468050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fb51e-e6de-48f5-9eff-2c3e488d5a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:41.492562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ea8fb51e-e6de-48f5-9eff-2c3e488d5a11 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:41.493696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ea8fb51e-e6de-48f5-9eff-2c3e488d5a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:41.561391 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 38/77] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:41.584338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8ab75-e03e-492c-82f3-3db9456a8881 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:41.596711 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8ab75-e03e-492c-82f3-3db9456a8881 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:41.600699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fdb93-c739-4608-a7f0-e5d34ce2c991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:41.601425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fdb93-c739-4608-a7f0-e5d34ce2c991 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:41.601714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fdb93-c739-4608-a7f0-e5d34ce2c991 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:41.602004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fdb93-c739-4608-a7f0-e5d34ce2c991 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:41.614245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fdb93-c739-4608-a7f0-e5d34ce2c991 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:41.620732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-a88fdb93-c739-4608-a7f0-e5d34ce2c991 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:37:41.621884 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 40/78] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:37:41.628025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb51e-e6de-48f5-9eff-2c3e488d5a11 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:41.636836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fb51e-e6de-48f5-9eff-2c3e488d5a11 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:41.641890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af101d8-8f4e-4ba5-bc0f-98274500d6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:41.642491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af101d8-8f4e-4ba5-bc0f-98274500d6dd admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:41.642781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af101d8-8f4e-4ba5-bc0f-98274500d6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:41.643069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af101d8-8f4e-4ba5-bc0f-98274500d6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:41.643832 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af101d8-8f4e-4ba5-bc0f-98274500d6dd admin admin] RBAC: Adding query filter params (name=member) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:41.644146 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af101d8-8f4e-4ba5-bc0f-98274500d6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:41.670324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af101d8-8f4e-4ba5-bc0f-98274500d6dd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:41.679109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 39/79] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:37:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:41.684961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fdb93-c739-4608-a7f0-e5d34ce2c991 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:41.694556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fdb93-c739-4608-a7f0-e5d34ce2c991 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:41.698676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4213-2865-4d77-92dd-9244f74a1d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:41.699512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4213-2865-4d77-92dd-9244f74a1d5a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:41.699805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4213-2865-4d77-92dd-9244f74a1d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:41.700093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4213-2865-4d77-92dd-9244f74a1d5a admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:41.701420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4213-2865-4d77-92dd-9244f74a1d5a admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:41.728853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4213-2865-4d77-92dd-9244f74a1d5a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:41.730400 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 41/80] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:41 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:41.736619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af101d8-8f4e-4ba5-bc0f-98274500d6dd admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:41.746105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af101d8-8f4e-4ba5-bc0f-98274500d6dd admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:41.750205 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf76fb-516e-4647-9bc7-8009aea18e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:41.750924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf76fb-516e-4647-9bc7-8009aea18e3c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:41.751217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf76fb-516e-4647-9bc7-8009aea18e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:41.751532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf76fb-516e-4647-9bc7-8009aea18e3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:41.759133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf76fb-516e-4647-9bc7-8009aea18e3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:41.785760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adf76fb-516e-4647-9bc7-8009aea18e3c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:41.794496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 40/81] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:41 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:41.800223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4213-2865-4d77-92dd-9244f74a1d5a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:41.809650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4213-2865-4d77-92dd-9244f74a1d5a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:41.813844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e13b0-990e-4db1-9eb0-9582393e3361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:41.814626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e13b0-990e-4db1-9eb0-9582393e3361 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:41.814921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e13b0-990e-4db1-9eb0-9582393e3361 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:41.815209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e13b0-990e-4db1-9eb0-9582393e3361 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:41.816322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e13b0-990e-4db1-9eb0-9582393e3361 admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:41.842736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e13b0-990e-4db1-9eb0-9582393e3361 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:41.844970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 42/82] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:41 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:41.850632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf76fb-516e-4647-9bc7-8009aea18e3c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:41.859240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adf76fb-516e-4647-9bc7-8009aea18e3c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:41.863795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032b862-f48b-4d5d-aafa-d80368694c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:41.864378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032b862-f48b-4d5d-aafa-d80368694c95 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:41.864670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032b862-f48b-4d5d-aafa-d80368694c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:41.865017 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032b862-f48b-4d5d-aafa-d80368694c95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:41.865800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032b862-f48b-4d5d-aafa-d80368694c95 admin admin] RBAC: Adding query filter params (role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=6989cbd135d744de861fa22cace1177a, user.id=c143e78768494434979863997771120b) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:41.866106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032b862-f48b-4d5d-aafa-d80368694c95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:41.891802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-8032b862-f48b-4d5d-aafa-d80368694c95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:41.891802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:37:41.891802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:37:41.892956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032b862-f48b-4d5d-aafa-d80368694c95 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:41.899165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 41/83] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:37:41 2022] GET /identity/v3/role_assignments?user.id=c143e78768494434979863997771120b&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:43.997631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d41e49-73eb-4649-bfbe-ae5385671063 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:43.998169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d41e49-73eb-4649-bfbe-ae5385671063 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:43.998169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d41e49-73eb-4649-bfbe-ae5385671063 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:44.000555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 43/84] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:44.006074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b9938-7d15-486d-be97-f2658b3d9915 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:44.006481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b9938-7d15-486d-be97-f2658b3d9915 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:44.006663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b9938-7d15-486d-be97-f2658b3d9915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:44.028526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-2d7b9938-7d15-486d-be97-f2658b3d9915 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:44.029659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-2d7b9938-7d15-486d-be97-f2658b3d9915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:44.036627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 42/85] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:44 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:44.060046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d41e49-73eb-4649-bfbe-ae5385671063 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:44.072777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d41e49-73eb-4649-bfbe-ae5385671063 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:44.076669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c91021-6c3e-4a5b-90b0-9f0504fb1e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:44.077385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c91021-6c3e-4a5b-90b0-9f0504fb1e05 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:44.077685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c91021-6c3e-4a5b-90b0-9f0504fb1e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:44.078034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c91021-6c3e-4a5b-90b0-9f0504fb1e05 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:44.092260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c91021-6c3e-4a5b-90b0-9f0504fb1e05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:44.099670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-b5c91021-6c3e-4a5b-90b0-9f0504fb1e05 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:37:44.100778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 44/86] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:37:44.106552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b9938-7d15-486d-be97-f2658b3d9915 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:44.116014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b9938-7d15-486d-be97-f2658b3d9915 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:44.120071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223550b-39be-4f42-97b2-c7583cb98d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:44.120668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223550b-39be-4f42-97b2-c7583cb98d46 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:44.120961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223550b-39be-4f42-97b2-c7583cb98d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:44.121295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223550b-39be-4f42-97b2-c7583cb98d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:44.122007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223550b-39be-4f42-97b2-c7583cb98d46 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:44.122311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223550b-39be-4f42-97b2-c7583cb98d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:44.147643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223550b-39be-4f42-97b2-c7583cb98d46 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:44.156751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 43/87] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:37:44.162413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c91021-6c3e-4a5b-90b0-9f0504fb1e05 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:44.172494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c91021-6c3e-4a5b-90b0-9f0504fb1e05 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:44.176570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242776-52cc-4055-8268-7723aeb5203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:44.177366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242776-52cc-4055-8268-7723aeb5203c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:44.177661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242776-52cc-4055-8268-7723aeb5203c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:44.177950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242776-52cc-4055-8268-7723aeb5203c admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:44.179038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85242776-52cc-4055-8268-7723aeb5203c admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:44.204756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85242776-52cc-4055-8268-7723aeb5203c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:44.206241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 45/88] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:44 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:37:44.212015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223550b-39be-4f42-97b2-c7583cb98d46 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:44.222394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223550b-39be-4f42-97b2-c7583cb98d46 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:44.226379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e547-1524-4c56-90e8-782590450705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:44.226957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e547-1524-4c56-90e8-782590450705 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:44.227253 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e547-1524-4c56-90e8-782590450705 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:44.227588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307e547-1524-4c56-90e8-782590450705 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:44.236462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e547-1524-4c56-90e8-782590450705 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:44.262270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307e547-1524-4c56-90e8-782590450705 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:44.271554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 44/89] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:44 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:44.277243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242776-52cc-4055-8268-7723aeb5203c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:44.287226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242776-52cc-4055-8268-7723aeb5203c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:44.291501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb1918-d2c5-4e24-8d39-12e52b3074b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:44.292282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb1918-d2c5-4e24-8d39-12e52b3074b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:44.292580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb1918-d2c5-4e24-8d39-12e52b3074b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:44.292871 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb1918-d2c5-4e24-8d39-12e52b3074b5 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:44.293960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb1918-d2c5-4e24-8d39-12e52b3074b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:44.320348 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb1918-d2c5-4e24-8d39-12e52b3074b5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:44.321880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 46/90] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:44 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:44.327637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e547-1524-4c56-90e8-782590450705 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:44.336773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307e547-1524-4c56-90e8-782590450705 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:44.340759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dec690-8229-439a-b7fb-e7e16a029ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:44.341340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dec690-8229-439a-b7fb-e7e16a029ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:44.341635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dec690-8229-439a-b7fb-e7e16a029ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:44.341925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dec690-8229-439a-b7fb-e7e16a029ca1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:44.342709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dec690-8229-439a-b7fb-e7e16a029ca1 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=6989cbd135d744de861fa22cace1177a, user.id=4b6ba909638e4d95a0827152d2079014) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:44.343018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dec690-8229-439a-b7fb-e7e16a029ca1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:44.370409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dec690-8229-439a-b7fb-e7e16a029ca1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:44.377097 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 45/91] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:37:44 2022] GET /identity/v3/role_assignments?user.id=4b6ba909638e4d95a0827152d2079014&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:37:46.331297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede9561-db88-43b6-b66f-7a93f87c3275 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:46.331831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede9561-db88-43b6-b66f-7a93f87c3275 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:46.331916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede9561-db88-43b6-b66f-7a93f87c3275 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:46.333546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 47/92] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:46.338772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2794-a976-4748-8f53-a383498fe482 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:46.339183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2794-a976-4748-8f53-a383498fe482 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:46.339299 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2794-a976-4748-8f53-a383498fe482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:46.362200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d2ee2794-a976-4748-8f53-a383498fe482 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:46.363361 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d2ee2794-a976-4748-8f53-a383498fe482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:46.370309 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 46/93] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:46 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:46.393007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede9561-db88-43b6-b66f-7a93f87c3275 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:46.404614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede9561-db88-43b6-b66f-7a93f87c3275 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:46.408606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149e76a-cb39-4d8a-a1d5-8098c7905f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:46.409317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149e76a-cb39-4d8a-a1d5-8098c7905f13 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:46.409611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149e76a-cb39-4d8a-a1d5-8098c7905f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:46.409895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149e76a-cb39-4d8a-a1d5-8098c7905f13 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:46.421826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149e76a-cb39-4d8a-a1d5-8098c7905f13 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:46.428317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-5149e76a-cb39-4d8a-a1d5-8098c7905f13 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:37:46.429582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 48/94] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:37:46.435581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2794-a976-4748-8f53-a383498fe482 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:46.444898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2794-a976-4748-8f53-a383498fe482 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:46.448873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440c591-8273-47c5-97e7-b478f598334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:46.449468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440c591-8273-47c5-97e7-b478f598334e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:46.449760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440c591-8273-47c5-97e7-b478f598334e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:46.450048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440c591-8273-47c5-97e7-b478f598334e admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:46.450757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440c591-8273-47c5-97e7-b478f598334e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:46.451058 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440c591-8273-47c5-97e7-b478f598334e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:46.477200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440c591-8273-47c5-97e7-b478f598334e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:46.486204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 47/95] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:46.491746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149e76a-cb39-4d8a-a1d5-8098c7905f13 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:46.502486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149e76a-cb39-4d8a-a1d5-8098c7905f13 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:46.506666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26519076-7992-497e-8e49-daec564189cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:46.507500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26519076-7992-497e-8e49-daec564189cf admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:46.507795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26519076-7992-497e-8e49-daec564189cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:46.508078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26519076-7992-497e-8e49-daec564189cf admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:46.509164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26519076-7992-497e-8e49-daec564189cf admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:46.535664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26519076-7992-497e-8e49-daec564189cf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:46.537193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 49/96] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:46 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:46.543071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440c591-8273-47c5-97e7-b478f598334e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:46.552412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440c591-8273-47c5-97e7-b478f598334e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:46.556271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad5058-118c-4c04-b63b-8385fd2d769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:46.557046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad5058-118c-4c04-b63b-8385fd2d769b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:46.557332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad5058-118c-4c04-b63b-8385fd2d769b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:46.557614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad5058-118c-4c04-b63b-8385fd2d769b admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:46.558671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad5058-118c-4c04-b63b-8385fd2d769b admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:46.585352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ad5058-118c-4c04-b63b-8385fd2d769b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:46.586868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 48/97] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:46 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:46.592411 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26519076-7992-497e-8e49-daec564189cf admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:46.602332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26519076-7992-497e-8e49-daec564189cf admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:46.606383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d8efa7-eae4-4ed0-9a74-895bd69cb10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:46.607189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8efa7-eae4-4ed0-9a74-895bd69cb10d admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:46.607527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8efa7-eae4-4ed0-9a74-895bd69cb10d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:46.607814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d8efa7-eae4-4ed0-9a74-895bd69cb10d admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a/users/4b6ba909638e4d95a0827152d2079014/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:46.609781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8efa7-eae4-4ed0-9a74-895bd69cb10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6989cbd135d744de861fa22cace1177a, user_id=4b6ba909638e4d95a0827152d2079014, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:46.645996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-e9d8efa7-eae4-4ed0-9a74-895bd69cb10d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:37:46.645996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:37:46.645996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:37:46.648035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d8efa7-eae4-4ed0-9a74-895bd69cb10d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:46.785162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 50/98] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:37:46 2022] PUT /identity/v3/projects/6989cbd135d744de861fa22cace1177a/users/4b6ba909638e4d95a0827152d2079014/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:37:48.777952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013813f-1e2d-4560-b016-feb28929928c None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:48.778514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013813f-1e2d-4560-b016-feb28929928c None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:48.778612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013813f-1e2d-4560-b016-feb28929928c None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:48.780372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 49/99] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:48.786256 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad59c2-25e7-4e6f-81c4-8a24385e96c1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:48.786635 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad59c2-25e7-4e6f-81c4-8a24385e96c1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:48.786960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad59c2-25e7-4e6f-81c4-8a24385e96c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:48.809734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-36ad59c2-25e7-4e6f-81c4-8a24385e96c1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:48.810876 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-36ad59c2-25e7-4e6f-81c4-8a24385e96c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:48.873858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 51/100] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:48 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:48.896554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013813f-1e2d-4560-b016-feb28929928c None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:48.908744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013813f-1e2d-4560-b016-feb28929928c None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:48.912635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11da182-5b55-4f83-b42c-f19c41b21d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:48.913604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11da182-5b55-4f83-b42c-f19c41b21d7b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:48.913899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11da182-5b55-4f83-b42c-f19c41b21d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:48.914184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11da182-5b55-4f83-b42c-f19c41b21d7b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:48.926611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11da182-5b55-4f83-b42c-f19c41b21d7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:48.933045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-c11da182-5b55-4f83-b42c-f19c41b21d7b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:37:48.934155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 50/101] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:37:48.939883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad59c2-25e7-4e6f-81c4-8a24385e96c1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:48.948527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad59c2-25e7-4e6f-81c4-8a24385e96c1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:48.952519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16d52e-1c0f-40a1-b4ba-518a30b8dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:48.953144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d52e-1c0f-40a1-b4ba-518a30b8dcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:48.953443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d52e-1c0f-40a1-b4ba-518a30b8dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:48.953727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d52e-1c0f-40a1-b4ba-518a30b8dcb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:48.954428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16d52e-1c0f-40a1-b4ba-518a30b8dcb9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:48.954733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16d52e-1c0f-40a1-b4ba-518a30b8dcb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:48.980524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16d52e-1c0f-40a1-b4ba-518a30b8dcb9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:48.989070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 52/102] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:48.994497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11da182-5b55-4f83-b42c-f19c41b21d7b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:49.003718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11da182-5b55-4f83-b42c-f19c41b21d7b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:49.007624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917963a9-84fb-4d6f-983b-9d6fe587a404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:49.008404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917963a9-84fb-4d6f-983b-9d6fe587a404 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:49.008690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917963a9-84fb-4d6f-983b-9d6fe587a404 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:49.008968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917963a9-84fb-4d6f-983b-9d6fe587a404 admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:49.010040 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917963a9-84fb-4d6f-983b-9d6fe587a404 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:49.036769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917963a9-84fb-4d6f-983b-9d6fe587a404 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:49.038164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 51/103] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:48 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:49.043749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16d52e-1c0f-40a1-b4ba-518a30b8dcb9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:49.053328 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16d52e-1c0f-40a1-b4ba-518a30b8dcb9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:49.057271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95553360-9bd3-4cfe-8ee5-b9e66ea7e1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:49.057848 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95553360-9bd3-4cfe-8ee5-b9e66ea7e1bd admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:49.058143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95553360-9bd3-4cfe-8ee5-b9e66ea7e1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:49.058432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95553360-9bd3-4cfe-8ee5-b9e66ea7e1bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:49.066113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95553360-9bd3-4cfe-8ee5-b9e66ea7e1bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:49.091880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95553360-9bd3-4cfe-8ee5-b9e66ea7e1bd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:49.101301 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 53/104] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:49 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:49.106872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917963a9-84fb-4d6f-983b-9d6fe587a404 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:49.116230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917963a9-84fb-4d6f-983b-9d6fe587a404 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:49.120326 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d00744-53f5-4b02-8d51-e418ea97fcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:49.121105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00744-53f5-4b02-8d51-e418ea97fcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:49.121397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00744-53f5-4b02-8d51-e418ea97fcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:49.121685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d00744-53f5-4b02-8d51-e418ea97fcf2 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:49.122754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d00744-53f5-4b02-8d51-e418ea97fcf2 admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:49.149383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d00744-53f5-4b02-8d51-e418ea97fcf2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:49.150934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 52/105] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:49 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:49.156649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95553360-9bd3-4cfe-8ee5-b9e66ea7e1bd admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:49.166266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95553360-9bd3-4cfe-8ee5-b9e66ea7e1bd admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:49.170237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d7824-ff9d-4b2b-ab93-b4f468e40b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:49.170807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d7824-ff9d-4b2b-ab93-b4f468e40b18 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:49.171101 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d7824-ff9d-4b2b-ab93-b4f468e40b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:49.171689 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d7824-ff9d-4b2b-ab93-b4f468e40b18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:49.172463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d7824-ff9d-4b2b-ab93-b4f468e40b18 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=6989cbd135d744de861fa22cace1177a, user.id=4b6ba909638e4d95a0827152d2079014) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:49.172764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d7824-ff9d-4b2b-ab93-b4f468e40b18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:49.198291 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d7824-ff9d-4b2b-ab93-b4f468e40b18 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:49.205182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 54/106] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:37:49 2022] GET /identity/v3/role_assignments?user.id=4b6ba909638e4d95a0827152d2079014&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:51.244276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b31510-61df-457d-bc05-3facfa5f214d None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:51.244825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b31510-61df-457d-bc05-3facfa5f214d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:51.244825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b31510-61df-457d-bc05-3facfa5f214d None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:51.246510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 53/107] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:51.252018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ced0a-0589-4edc-83e4-5cb457ba042b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:51.252381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ced0a-0589-4edc-83e4-5cb457ba042b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:51.252596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ced0a-0589-4edc-83e4-5cb457ba042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:51.275333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b98ced0a-0589-4edc-83e4-5cb457ba042b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:51.276480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b98ced0a-0589-4edc-83e4-5cb457ba042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:51.283980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 55/108] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:51 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:51.306845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b31510-61df-457d-bc05-3facfa5f214d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:51.323484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b31510-61df-457d-bc05-3facfa5f214d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:51.328973 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e85ae-5f30-4394-a506-a38ac9c545b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:51.330190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e85ae-5f30-4394-a506-a38ac9c545b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:51.330628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e85ae-5f30-4394-a506-a38ac9c545b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:51.330925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e85ae-5f30-4394-a506-a38ac9c545b6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:51.345142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e85ae-5f30-4394-a506-a38ac9c545b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:51.357638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-d15e85ae-5f30-4394-a506-a38ac9c545b6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:37:51.359235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 54/109] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:37:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:37:51.365485 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ced0a-0589-4edc-83e4-5cb457ba042b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:51.374344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ced0a-0589-4edc-83e4-5cb457ba042b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:51.379020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3679f-df90-43b3-82b4-cc2b2204d734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:51.379662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3679f-df90-43b3-82b4-cc2b2204d734 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:51.380066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3679f-df90-43b3-82b4-cc2b2204d734 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:51.380361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3679f-df90-43b3-82b4-cc2b2204d734 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:51.381079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3679f-df90-43b3-82b4-cc2b2204d734 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:51.381387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3679f-df90-43b3-82b4-cc2b2204d734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:51.409346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3679f-df90-43b3-82b4-cc2b2204d734 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:51.419119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 56/110] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:37:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:51.425681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e85ae-5f30-4394-a506-a38ac9c545b6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:51.438353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e85ae-5f30-4394-a506-a38ac9c545b6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:51.442981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25807bd-32bb-409a-8b27-4cd5bcd90a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:51.444953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25807bd-32bb-409a-8b27-4cd5bcd90a8d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:51.445352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25807bd-32bb-409a-8b27-4cd5bcd90a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:51.445631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25807bd-32bb-409a-8b27-4cd5bcd90a8d admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:51.446763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25807bd-32bb-409a-8b27-4cd5bcd90a8d admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:51.486895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25807bd-32bb-409a-8b27-4cd5bcd90a8d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:51.488558 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 55/111] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:51 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:37:51.495867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3679f-df90-43b3-82b4-cc2b2204d734 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:51.511630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3679f-df90-43b3-82b4-cc2b2204d734 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:51.517426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4fedb-daf2-4fb8-a1aa-c47a9b28ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:51.518295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4fedb-daf2-4fb8-a1aa-c47a9b28ef00 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:51.518627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4fedb-daf2-4fb8-a1aa-c47a9b28ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:51.518915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4fedb-daf2-4fb8-a1aa-c47a9b28ef00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:51.529481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4fedb-daf2-4fb8-a1aa-c47a9b28ef00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:51.556622 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4fedb-daf2-4fb8-a1aa-c47a9b28ef00 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:51.566662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 57/112] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:51 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:51.573409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25807bd-32bb-409a-8b27-4cd5bcd90a8d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:51.584581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25807bd-32bb-409a-8b27-4cd5bcd90a8d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:51.588793 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92ddfa-792a-442b-b16c-1638ea63dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:51.589597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ddfa-792a-442b-b16c-1638ea63dd2a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:51.589880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ddfa-792a-442b-b16c-1638ea63dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:51.590162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ddfa-792a-442b-b16c-1638ea63dd2a admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:51.591292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ddfa-792a-442b-b16c-1638ea63dd2a admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:51.618400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ddfa-792a-442b-b16c-1638ea63dd2a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:51.620036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 56/113] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:51 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:51.628839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4fedb-daf2-4fb8-a1aa-c47a9b28ef00 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:51.642579 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4fedb-daf2-4fb8-a1aa-c47a9b28ef00 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:51.648487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fcff1-587b-4e99-8217-b109ee51db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:51.649525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fcff1-587b-4e99-8217-b109ee51db94 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:51.649525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fcff1-587b-4e99-8217-b109ee51db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:51.649690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fcff1-587b-4e99-8217-b109ee51db94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:51.650412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fcff1-587b-4e99-8217-b109ee51db94 admin admin] RBAC: Adding query filter params (role.id=3876294260db4719972a530e23d90b2f, scope.project.id=6989cbd135d744de861fa22cace1177a, user.id=c143e78768494434979863997771120b) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:51.650882 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fcff1-587b-4e99-8217-b109ee51db94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:51.688245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fcff1-587b-4e99-8217-b109ee51db94 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:51.694322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 58/114] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:37:51 2022] GET /identity/v3/role_assignments?user.id=c143e78768494434979863997771120b&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=3876294260db4719972a530e23d90b2f => generated 259 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:53.733686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b0dfd-47fa-4fb1-85b7-55b7dd00093b None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:53.734317 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b0dfd-47fa-4fb1-85b7-55b7dd00093b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:53.734579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b0dfd-47fa-4fb1-85b7-55b7dd00093b None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:53.736322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 57/115] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:53.741441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b747e-feb3-4fb3-8a83-55cccc6f80af None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:53.741962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b747e-feb3-4fb3-8a83-55cccc6f80af None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:53.742640 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b747e-feb3-4fb3-8a83-55cccc6f80af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:53.766960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-971b747e-feb3-4fb3-8a83-55cccc6f80af None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:53.768163 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-971b747e-feb3-4fb3-8a83-55cccc6f80af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:53.774805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 59/116] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:53.797726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b0dfd-47fa-4fb1-85b7-55b7dd00093b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:53.809288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b0dfd-47fa-4fb1-85b7-55b7dd00093b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:53.813185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0914d2-6cf0-4315-928c-519aa73c8cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:53.813904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0914d2-6cf0-4315-928c-519aa73c8cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:53.814221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0914d2-6cf0-4315-928c-519aa73c8cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:53.814505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0914d2-6cf0-4315-928c-519aa73c8cf8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:53.825354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0914d2-6cf0-4315-928c-519aa73c8cf8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:53.832466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-ed0914d2-6cf0-4315-928c-519aa73c8cf8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:37:53.833523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 58/117] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:37:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:37:53.838914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b747e-feb3-4fb3-8a83-55cccc6f80af None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:53.848133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b747e-feb3-4fb3-8a83-55cccc6f80af None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:53.852112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc144f-6eb7-46f0-9257-a591805a3a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:53.852704 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc144f-6eb7-46f0-9257-a591805a3a2e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:53.853001 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc144f-6eb7-46f0-9257-a591805a3a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:53.853289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc144f-6eb7-46f0-9257-a591805a3a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:53.853991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc144f-6eb7-46f0-9257-a591805a3a2e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:53.854296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc144f-6eb7-46f0-9257-a591805a3a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:53.880071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc144f-6eb7-46f0-9257-a591805a3a2e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:53.889204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 60/118] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:37:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:53.895132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0914d2-6cf0-4315-928c-519aa73c8cf8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:53.905930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0914d2-6cf0-4315-928c-519aa73c8cf8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:53.910046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e5580-56d4-4ec9-ae12-e5075231513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:53.910827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e5580-56d4-4ec9-ae12-e5075231513c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:53.911115 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e5580-56d4-4ec9-ae12-e5075231513c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:53.911437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e5580-56d4-4ec9-ae12-e5075231513c admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:53.912503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e5580-56d4-4ec9-ae12-e5075231513c admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:53.939124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e5580-56d4-4ec9-ae12-e5075231513c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:53.940626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 59/119] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:53 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:53.945820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc144f-6eb7-46f0-9257-a591805a3a2e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:53.955674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc144f-6eb7-46f0-9257-a591805a3a2e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:53.959657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412c68c-e775-44b9-bbe8-bd6e779f32ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:53.960441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c68c-e775-44b9-bbe8-bd6e779f32ad admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:53.960738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c68c-e775-44b9-bbe8-bd6e779f32ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:53.961031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412c68c-e775-44b9-bbe8-bd6e779f32ad admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:53.962113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c68c-e775-44b9-bbe8-bd6e779f32ad admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:53.988084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412c68c-e775-44b9-bbe8-bd6e779f32ad admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:53.989604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 61/120] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:53 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:53.995119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e5580-56d4-4ec9-ae12-e5075231513c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:54.005590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e5580-56d4-4ec9-ae12-e5075231513c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:54.009617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c99837-2100-4c80-ac34-385018e7a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:54.010425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c99837-2100-4c80-ac34-385018e7a425 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:54.010722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c99837-2100-4c80-ac34-385018e7a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:54.011012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c99837-2100-4c80-ac34-385018e7a425 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a/users/c143e78768494434979863997771120b/roles/3876294260db4719972a530e23d90b2f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:54.013021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c99837-2100-4c80-ac34-385018e7a425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6989cbd135d744de861fa22cace1177a, user_id=c143e78768494434979863997771120b, role_id=3876294260db4719972a530e23d90b2f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:54.040856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c99837-2100-4c80-ac34-385018e7a425 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:54.109427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 60/121] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:37:53 2022] PUT /identity/v3/projects/6989cbd135d744de861fa22cace1177a/users/c143e78768494434979863997771120b/roles/3876294260db4719972a530e23d90b2f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:37:56.111955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccababed-4ad7-4bb3-a617-f081018f1bc4 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:56.112435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccababed-4ad7-4bb3-a617-f081018f1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:56.112522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccababed-4ad7-4bb3-a617-f081018f1bc4 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:56.114240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 62/122] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:56.119272 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bef8b-9598-4b98-8fd5-4b6a99be784f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:56.119670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bef8b-9598-4b98-8fd5-4b6a99be784f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:56.119896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bef8b-9598-4b98-8fd5-4b6a99be784f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:56.142864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-6d3bef8b-9598-4b98-8fd5-4b6a99be784f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:56.144030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6d3bef8b-9598-4b98-8fd5-4b6a99be784f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:56.209358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 61/123] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:56 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:56.232327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccababed-4ad7-4bb3-a617-f081018f1bc4 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:56.244677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccababed-4ad7-4bb3-a617-f081018f1bc4 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:56.248552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91508703-da3d-430c-b979-0d801edaa701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:56.249406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91508703-da3d-430c-b979-0d801edaa701 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:56.249905 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91508703-da3d-430c-b979-0d801edaa701 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:56.250202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91508703-da3d-430c-b979-0d801edaa701 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:56.262029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91508703-da3d-430c-b979-0d801edaa701 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:56.268943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-91508703-da3d-430c-b979-0d801edaa701 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:37:56.270009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 63/124] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:37:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:37:56.275574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bef8b-9598-4b98-8fd5-4b6a99be784f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:56.285111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bef8b-9598-4b98-8fd5-4b6a99be784f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:56.289375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af779-e542-4e34-b911-92197604ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:56.289972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af779-e542-4e34-b911-92197604ca7b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:56.290266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af779-e542-4e34-b911-92197604ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:56.290555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af779-e542-4e34-b911-92197604ca7b admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:56.291274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1af779-e542-4e34-b911-92197604ca7b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:56.291611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1af779-e542-4e34-b911-92197604ca7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:56.318512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1af779-e542-4e34-b911-92197604ca7b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:56.327893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 62/125] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:37:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:56.333719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91508703-da3d-430c-b979-0d801edaa701 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:56.343625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91508703-da3d-430c-b979-0d801edaa701 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:56.347659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebba321-446d-4ddc-b7bc-eb54b4512e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:56.348454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebba321-446d-4ddc-b7bc-eb54b4512e0f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:56.348747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebba321-446d-4ddc-b7bc-eb54b4512e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:56.349034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebba321-446d-4ddc-b7bc-eb54b4512e0f admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:56.350127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebba321-446d-4ddc-b7bc-eb54b4512e0f admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:56.376649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebba321-446d-4ddc-b7bc-eb54b4512e0f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:56.378119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 64/126] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:56 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:56.383580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af779-e542-4e34-b911-92197604ca7b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:56.393429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af779-e542-4e34-b911-92197604ca7b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:56.397426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970e2d1-de96-4149-a02a-57c8f98c2cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:56.398001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970e2d1-de96-4149-a02a-57c8f98c2cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:56.398295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970e2d1-de96-4149-a02a-57c8f98c2cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:56.398583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970e2d1-de96-4149-a02a-57c8f98c2cb9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:56.406172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970e2d1-de96-4149-a02a-57c8f98c2cb9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:56.431863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970e2d1-de96-4149-a02a-57c8f98c2cb9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:56.440781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 63/127] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:56 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:56.446281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebba321-446d-4ddc-b7bc-eb54b4512e0f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:56.456113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebba321-446d-4ddc-b7bc-eb54b4512e0f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:56.460102 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606fe2c-059d-452c-a831-58e08ce1d8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:56.460878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606fe2c-059d-452c-a831-58e08ce1d8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:56.461174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606fe2c-059d-452c-a831-58e08ce1d8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:56.461462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606fe2c-059d-452c-a831-58e08ce1d8e6 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:56.462538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606fe2c-059d-452c-a831-58e08ce1d8e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:56.489081 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606fe2c-059d-452c-a831-58e08ce1d8e6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:56.490612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 65/128] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:56 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:56.496188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970e2d1-de96-4149-a02a-57c8f98c2cb9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:56.505522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970e2d1-de96-4149-a02a-57c8f98c2cb9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:56.509964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7323-7675-4a8f-b019-829d099b8702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:56.510546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7323-7675-4a8f-b019-829d099b8702 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:56.510836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7323-7675-4a8f-b019-829d099b8702 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:56.511122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7323-7675-4a8f-b019-829d099b8702 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:56.511943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d7323-7675-4a8f-b019-829d099b8702 admin admin] RBAC: Adding query filter params (role.id=3876294260db4719972a530e23d90b2f, scope.project.id=6989cbd135d744de861fa22cace1177a, user.id=c143e78768494434979863997771120b) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:56.512252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d7323-7675-4a8f-b019-829d099b8702 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:56.539702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d7323-7675-4a8f-b019-829d099b8702 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:56.545917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 64/129] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:37:56 2022] GET /identity/v3/role_assignments?user.id=c143e78768494434979863997771120b&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=3876294260db4719972a530e23d90b2f => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:58.569557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec89c5-59cb-4918-a1fc-13ac85932063 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:58.570096 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec89c5-59cb-4918-a1fc-13ac85932063 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:58.570280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec89c5-59cb-4918-a1fc-13ac85932063 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:58.571847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 66/130] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:37:58.576747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91563f-7fa0-40ea-b05a-6ff9aab8f672 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:58.577142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91563f-7fa0-40ea-b05a-6ff9aab8f672 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:58.577336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91563f-7fa0-40ea-b05a-6ff9aab8f672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:58.601153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-bc91563f-7fa0-40ea-b05a-6ff9aab8f672 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:37:58.602292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bc91563f-7fa0-40ea-b05a-6ff9aab8f672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:37:58.609819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 65/131] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:37:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:37:58.632170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec89c5-59cb-4918-a1fc-13ac85932063 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:58.644002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec89c5-59cb-4918-a1fc-13ac85932063 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:58.647930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b859c-4f51-4c06-9ab4-503ec69abd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:58.648648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b859c-4f51-4c06-9ab4-503ec69abd99 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:58.648944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b859c-4f51-4c06-9ab4-503ec69abd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:58.649233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b859c-4f51-4c06-9ab4-503ec69abd99 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:58.660861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b859c-4f51-4c06-9ab4-503ec69abd99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:37:58.667377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-e81b859c-4f51-4c06-9ab4-503ec69abd99 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:37:58.668458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 67/132] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:37:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:37:58.677130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91563f-7fa0-40ea-b05a-6ff9aab8f672 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:58.690371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91563f-7fa0-40ea-b05a-6ff9aab8f672 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:58.694474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53384764-424f-4236-b368-036434196cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:58.695080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53384764-424f-4236-b368-036434196cea admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:58.695395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53384764-424f-4236-b368-036434196cea admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:58.695682 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53384764-424f-4236-b368-036434196cea admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:58.696397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53384764-424f-4236-b368-036434196cea admin admin] RBAC: Adding query filter params (name=member) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:58.696700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53384764-424f-4236-b368-036434196cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:58.722692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53384764-424f-4236-b368-036434196cea admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:58.731812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 66/133] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:37:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:58.738293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b859c-4f51-4c06-9ab4-503ec69abd99 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:58.748620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b859c-4f51-4c06-9ab4-503ec69abd99 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:58.752595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdb756-b8d3-4a43-b89c-94677d728a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:58.753383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdb756-b8d3-4a43-b89c-94677d728a76 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:58.753677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdb756-b8d3-4a43-b89c-94677d728a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:58.753965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdb756-b8d3-4a43-b89c-94677d728a76 admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:58.755046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdb756-b8d3-4a43-b89c-94677d728a76 admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:58.781883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdb756-b8d3-4a43-b89c-94677d728a76 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:58.783361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 68/134] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:37:58 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:58.788991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53384764-424f-4236-b368-036434196cea admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:58.798378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53384764-424f-4236-b368-036434196cea admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:58.803071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28017f7a-470d-4e5c-9435-2baf8b904fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:58.803692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28017f7a-470d-4e5c-9435-2baf8b904fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:58.803989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28017f7a-470d-4e5c-9435-2baf8b904fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:58.804275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28017f7a-470d-4e5c-9435-2baf8b904fd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:58.812190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28017f7a-470d-4e5c-9435-2baf8b904fd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:58.837990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28017f7a-470d-4e5c-9435-2baf8b904fd1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:58.847632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 67/135] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:37:58 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:37:58.853255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdb756-b8d3-4a43-b89c-94677d728a76 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:58.863059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdb756-b8d3-4a43-b89c-94677d728a76 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:58.867016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47910e5e-e481-4b4d-92bc-86bf8b006dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:58.867834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47910e5e-e481-4b4d-92bc-86bf8b006dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:58.868131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47910e5e-e481-4b4d-92bc-86bf8b006dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:58.868419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47910e5e-e481-4b4d-92bc-86bf8b006dd0 admin admin] PATH_INFO: `/v3/projects/e94347012917407aa446d366e5635e39` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:58.869501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47910e5e-e481-4b4d-92bc-86bf8b006dd0 admin admin] RBAC: Authorizing `identity:get_project(project_id=e94347012917407aa446d366e5635e39)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:58.896038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47910e5e-e481-4b4d-92bc-86bf8b006dd0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:58.897582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 69/136] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:37:58 2022] GET /identity/v3/projects/e94347012917407aa446d366e5635e39 => generated 312 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:37:58.903333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28017f7a-470d-4e5c-9435-2baf8b904fd1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:37:58.912557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28017f7a-470d-4e5c-9435-2baf8b904fd1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:37:58.916790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80238fe-2ffa-4cc0-998c-816276612285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:37:58.917422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80238fe-2ffa-4cc0-998c-816276612285 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:37:58.917711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80238fe-2ffa-4cc0-998c-816276612285 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:37:58.917996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80238fe-2ffa-4cc0-998c-816276612285 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:37:58.918762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80238fe-2ffa-4cc0-998c-816276612285 admin admin] RBAC: Adding query filter params (role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=e94347012917407aa446d366e5635e39, user.id=c143e78768494434979863997771120b) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:37:58.919066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80238fe-2ffa-4cc0-998c-816276612285 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:37:58.945064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80238fe-2ffa-4cc0-998c-816276612285 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:37:58.950697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 68/137] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:37:58 2022] GET /identity/v3/role_assignments?user.id=c143e78768494434979863997771120b&scope.project.id=e94347012917407aa446d366e5635e39&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:00.939966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3fc7f-29f0-4a68-bb51-5bc8f960c7bb None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:00.940486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3fc7f-29f0-4a68-bb51-5bc8f960c7bb None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:00.940575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3fc7f-29f0-4a68-bb51-5bc8f960c7bb None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:00.942218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 70/138] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:00.947478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6681fa-51eb-4e78-ad89-f6ebcf5157b6 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:00.947846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6681fa-51eb-4e78-ad89-f6ebcf5157b6 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:00.948057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6681fa-51eb-4e78-ad89-f6ebcf5157b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:00.970902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-7d6681fa-51eb-4e78-ad89-f6ebcf5157b6 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:00.972034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7d6681fa-51eb-4e78-ad89-f6ebcf5157b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:00.978871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 69/139] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:00 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:00.999898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3fc7f-29f0-4a68-bb51-5bc8f960c7bb None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:01.011381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3fc7f-29f0-4a68-bb51-5bc8f960c7bb None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:01.015788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34411c0f-6bcb-4a9b-9572-f1049cd30c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:01.016503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34411c0f-6bcb-4a9b-9572-f1049cd30c57 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:01.016797 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34411c0f-6bcb-4a9b-9572-f1049cd30c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:01.017084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34411c0f-6bcb-4a9b-9572-f1049cd30c57 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:01.028109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34411c0f-6bcb-4a9b-9572-f1049cd30c57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:01.034972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-34411c0f-6bcb-4a9b-9572-f1049cd30c57 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:01.036080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 71/140] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:38:01.042059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6681fa-51eb-4e78-ad89-f6ebcf5157b6 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:01.050744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6681fa-51eb-4e78-ad89-f6ebcf5157b6 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:01.054639 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107c03-a5f0-4839-9e74-2121255c985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:01.055234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107c03-a5f0-4839-9e74-2121255c985c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:01.055550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107c03-a5f0-4839-9e74-2121255c985c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:01.055834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107c03-a5f0-4839-9e74-2121255c985c admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:01.056541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107c03-a5f0-4839-9e74-2121255c985c admin admin] RBAC: Adding query filter params (name=member) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:01.056838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107c03-a5f0-4839-9e74-2121255c985c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:01.082793 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107c03-a5f0-4839-9e74-2121255c985c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:01.092061 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 70/141] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:01.098272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34411c0f-6bcb-4a9b-9572-f1049cd30c57 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:01.108667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34411c0f-6bcb-4a9b-9572-f1049cd30c57 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:01.112591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728a28c-02ac-4cdb-a286-ecce96bc5e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:01.113376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728a28c-02ac-4cdb-a286-ecce96bc5e05 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:01.113668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728a28c-02ac-4cdb-a286-ecce96bc5e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:01.113951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728a28c-02ac-4cdb-a286-ecce96bc5e05 admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:01.115040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728a28c-02ac-4cdb-a286-ecce96bc5e05 admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:01.141936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728a28c-02ac-4cdb-a286-ecce96bc5e05 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:01.143402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 72/142] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:01 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:01.148665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107c03-a5f0-4839-9e74-2121255c985c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:01.157987 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107c03-a5f0-4839-9e74-2121255c985c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:01.161967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c32c2-9d3e-4ce8-9eba-9563fb5b6eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:01.163006 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c32c2-9d3e-4ce8-9eba-9563fb5b6eab admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:01.163296 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c32c2-9d3e-4ce8-9eba-9563fb5b6eab admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:01.163606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c32c2-9d3e-4ce8-9eba-9563fb5b6eab admin admin] PATH_INFO: `/v3/projects/e94347012917407aa446d366e5635e39` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:01.164674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c32c2-9d3e-4ce8-9eba-9563fb5b6eab admin admin] RBAC: Authorizing `identity:get_project(project_id=e94347012917407aa446d366e5635e39)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:01.190811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c32c2-9d3e-4ce8-9eba-9563fb5b6eab admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:01.192355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 71/143] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:01 2022] GET /identity/v3/projects/e94347012917407aa446d366e5635e39 => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:01.197860 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728a28c-02ac-4cdb-a286-ecce96bc5e05 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:01.207948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728a28c-02ac-4cdb-a286-ecce96bc5e05 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:01.211844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da734274-5e0e-4ee3-9a53-6c6b37469b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:01.212653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da734274-5e0e-4ee3-9a53-6c6b37469b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:01.212944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da734274-5e0e-4ee3-9a53-6c6b37469b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:01.213226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da734274-5e0e-4ee3-9a53-6c6b37469b6c admin admin] PATH_INFO: `/v3/projects/e94347012917407aa446d366e5635e39/users/c143e78768494434979863997771120b/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:01.214944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da734274-5e0e-4ee3-9a53-6c6b37469b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94347012917407aa446d366e5635e39, user_id=c143e78768494434979863997771120b, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:01.241542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da734274-5e0e-4ee3-9a53-6c6b37469b6c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:01.321377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 73/144] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:38:01 2022] PUT /identity/v3/projects/e94347012917407aa446d366e5635e39/users/c143e78768494434979863997771120b/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 12:38:03.324452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79f62f-8b50-4a1e-b643-b241920f4139 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:03.324961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79f62f-8b50-4a1e-b643-b241920f4139 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:03.325045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79f62f-8b50-4a1e-b643-b241920f4139 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:03.326743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 72/145] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:03.332510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825363f0-2d12-4a99-8cdd-9e0a24bcd0a2 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:03.332918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825363f0-2d12-4a99-8cdd-9e0a24bcd0a2 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:03.333089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825363f0-2d12-4a99-8cdd-9e0a24bcd0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:03.356574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-825363f0-2d12-4a99-8cdd-9e0a24bcd0a2 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:03.357640 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-825363f0-2d12-4a99-8cdd-9e0a24bcd0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:03.430268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 74/146] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:03 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:03.453618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79f62f-8b50-4a1e-b643-b241920f4139 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:03.466337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79f62f-8b50-4a1e-b643-b241920f4139 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:03.471176 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b394d62-d214-407e-ac28-8f2197bae853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:03.471959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b394d62-d214-407e-ac28-8f2197bae853 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:03.472419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b394d62-d214-407e-ac28-8f2197bae853 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:03.472713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b394d62-d214-407e-ac28-8f2197bae853 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:03.485967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b394d62-d214-407e-ac28-8f2197bae853 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:03.492564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-1b394d62-d214-407e-ac28-8f2197bae853 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:03.494050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 73/147] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:03.501082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825363f0-2d12-4a99-8cdd-9e0a24bcd0a2 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:03.513329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825363f0-2d12-4a99-8cdd-9e0a24bcd0a2 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:03.519139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47396c9-764c-4afd-81ab-e87529da6f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:03.519781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47396c9-764c-4afd-81ab-e87529da6f3b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:03.520071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47396c9-764c-4afd-81ab-e87529da6f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:03.520357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47396c9-764c-4afd-81ab-e87529da6f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:03.521144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47396c9-764c-4afd-81ab-e87529da6f3b admin admin] RBAC: Adding query filter params (name=member) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:03.521411 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47396c9-764c-4afd-81ab-e87529da6f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:03.547379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47396c9-764c-4afd-81ab-e87529da6f3b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:03.556750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 75/148] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:03.562761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b394d62-d214-407e-ac28-8f2197bae853 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:03.572053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b394d62-d214-407e-ac28-8f2197bae853 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:03.576053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e017d-183d-4335-9ccf-fe30ad45b5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:03.577560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e017d-183d-4335-9ccf-fe30ad45b5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:03.577874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e017d-183d-4335-9ccf-fe30ad45b5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:03.578160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e017d-183d-4335-9ccf-fe30ad45b5f3 admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:03.579254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e017d-183d-4335-9ccf-fe30ad45b5f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:03.604841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e017d-183d-4335-9ccf-fe30ad45b5f3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:03.606363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 74/149] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:03 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:03.612269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47396c9-764c-4afd-81ab-e87529da6f3b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:03.621527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47396c9-764c-4afd-81ab-e87529da6f3b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:03.626505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e6ac6-f983-4fbe-994c-d84f02615c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:03.627075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6ac6-f983-4fbe-994c-d84f02615c54 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:03.627396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6ac6-f983-4fbe-994c-d84f02615c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:03.627680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6ac6-f983-4fbe-994c-d84f02615c54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:03.635227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e6ac6-f983-4fbe-994c-d84f02615c54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:03.661363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e6ac6-f983-4fbe-994c-d84f02615c54 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:03.670044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 76/150] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:03 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:03.675633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e017d-183d-4335-9ccf-fe30ad45b5f3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:03.684816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e017d-183d-4335-9ccf-fe30ad45b5f3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:03.690157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa46d31-3e94-480f-9079-0e8e5ab7f9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:03.690945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa46d31-3e94-480f-9079-0e8e5ab7f9dc admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:03.691236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa46d31-3e94-480f-9079-0e8e5ab7f9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:03.691547 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa46d31-3e94-480f-9079-0e8e5ab7f9dc admin admin] PATH_INFO: `/v3/projects/e94347012917407aa446d366e5635e39` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:03.692627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa46d31-3e94-480f-9079-0e8e5ab7f9dc admin admin] RBAC: Authorizing `identity:get_project(project_id=e94347012917407aa446d366e5635e39)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:03.719242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa46d31-3e94-480f-9079-0e8e5ab7f9dc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:03.720855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 75/151] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:03 2022] GET /identity/v3/projects/e94347012917407aa446d366e5635e39 => generated 312 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:03.726585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e6ac6-f983-4fbe-994c-d84f02615c54 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:03.736186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e6ac6-f983-4fbe-994c-d84f02615c54 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:03.740245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4965a51-d18e-478f-974a-756d68a303b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:03.740825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4965a51-d18e-478f-974a-756d68a303b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:03.741120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4965a51-d18e-478f-974a-756d68a303b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:03.741407 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4965a51-d18e-478f-974a-756d68a303b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:03.742184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4965a51-d18e-478f-974a-756d68a303b1 admin admin] RBAC: Adding query filter params (role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=e94347012917407aa446d366e5635e39, user.id=c143e78768494434979863997771120b) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:03.742596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4965a51-d18e-478f-974a-756d68a303b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:03.769002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4965a51-d18e-478f-974a-756d68a303b1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:03.775266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 77/152] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:38:03 2022] GET /identity/v3/role_assignments?user.id=c143e78768494434979863997771120b&scope.project.id=e94347012917407aa446d366e5635e39&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:05.804897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569364-3eb4-43f7-8114-6e64925db827 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:05.805416 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569364-3eb4-43f7-8114-6e64925db827 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:05.805525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39569364-3eb4-43f7-8114-6e64925db827 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:05.807233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 76/153] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:05.812526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0154-d46f-47f2-99ac-ff20c8215271 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:05.812914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0154-d46f-47f2-99ac-ff20c8215271 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:05.813107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0154-d46f-47f2-99ac-ff20c8215271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:05.835479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-237c0154-d46f-47f2-99ac-ff20c8215271 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:05.836627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-237c0154-d46f-47f2-99ac-ff20c8215271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:05.844164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 78/154] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:05.866947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569364-3eb4-43f7-8114-6e64925db827 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:05.879827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39569364-3eb4-43f7-8114-6e64925db827 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:05.883662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf50d9-22c5-4668-b484-f3bcb2dd387a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:05.884374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf50d9-22c5-4668-b484-f3bcb2dd387a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:05.884741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf50d9-22c5-4668-b484-f3bcb2dd387a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:05.885029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf50d9-22c5-4668-b484-f3bcb2dd387a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:05.886072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf50d9-22c5-4668-b484-f3bcb2dd387a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:05.911712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf50d9-22c5-4668-b484-f3bcb2dd387a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:05.913522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 77/155] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:05.919206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0154-d46f-47f2-99ac-ff20c8215271 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:05.929262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0154-d46f-47f2-99ac-ff20c8215271 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:05.933262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09845f-cf44-4d68-8145-17ce589b9c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:05.933852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09845f-cf44-4d68-8145-17ce589b9c1f admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:05.934146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09845f-cf44-4d68-8145-17ce589b9c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:05.934434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09845f-cf44-4d68-8145-17ce589b9c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:05.935088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09845f-cf44-4d68-8145-17ce589b9c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:05.962459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09845f-cf44-4d68-8145-17ce589b9c1f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:06.053054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 79/156] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:38:05 2022] POST /identity/v3/projects => generated 302 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:38:08.044859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e444a-c6c2-477a-a43c-1773e89a71f5 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:08.045453 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e444a-c6c2-477a-a43c-1773e89a71f5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:08.045453 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e444a-c6c2-477a-a43c-1773e89a71f5 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:08.047121 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 78/157] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:08.053581 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca01d8-f1ee-4930-acaa-c1d5bfcf9998 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:08.054013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca01d8-f1ee-4930-acaa-c1d5bfcf9998 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:08.054179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca01d8-f1ee-4930-acaa-c1d5bfcf9998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:08.075771 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b6ca01d8-f1ee-4930-acaa-c1d5bfcf9998 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:08.077515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b6ca01d8-f1ee-4930-acaa-c1d5bfcf9998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:08.143677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 80/158] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:08 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:08.167509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e444a-c6c2-477a-a43c-1773e89a71f5 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:08.179079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e444a-c6c2-477a-a43c-1773e89a71f5 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:08.182896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dcaff-d16c-4605-b39f-ecfb42970aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:08.183639 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dcaff-d16c-4605-b39f-ecfb42970aba admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:08.183932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dcaff-d16c-4605-b39f-ecfb42970aba admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:08.184216 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dcaff-d16c-4605-b39f-ecfb42970aba admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:08.185270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dcaff-d16c-4605-b39f-ecfb42970aba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:08.211973 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dcaff-d16c-4605-b39f-ecfb42970aba admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:08.213430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 79/159] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:38:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:08.218817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca01d8-f1ee-4930-acaa-c1d5bfcf9998 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:08.228916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca01d8-f1ee-4930-acaa-c1d5bfcf9998 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:08.234018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94614961-4807-4613-a84f-90842bef8b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:08.234856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614961-4807-4613-a84f-90842bef8b0a admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:08.235392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614961-4807-4613-a84f-90842bef8b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:08.235902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94614961-4807-4613-a84f-90842bef8b0a admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:08.243153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94614961-4807-4613-a84f-90842bef8b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:08.263187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94614961-4807-4613-a84f-90842bef8b0a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:08.349190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 81/160] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:38:08 2022] POST /identity/v3/users => generated 283 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:38:10.364582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33d6cd-0b1b-4c35-9ae4-80f0471bbcf5 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:10.365084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33d6cd-0b1b-4c35-9ae4-80f0471bbcf5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:10.365084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33d6cd-0b1b-4c35-9ae4-80f0471bbcf5 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:10.366755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 80/161] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:10.371715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd23fdf-653b-4cff-9817-71dc410ae2d3 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:10.372138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd23fdf-653b-4cff-9817-71dc410ae2d3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:10.372296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd23fdf-653b-4cff-9817-71dc410ae2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:10.396013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-ecd23fdf-653b-4cff-9817-71dc410ae2d3 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:10.397139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ecd23fdf-653b-4cff-9817-71dc410ae2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:10.403720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 82/162] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:10 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:10.426926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33d6cd-0b1b-4c35-9ae4-80f0471bbcf5 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:10.439502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33d6cd-0b1b-4c35-9ae4-80f0471bbcf5 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:10.443559 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4bc1c-0b29-4566-9029-bcc77582e095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:10.444280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4bc1c-0b29-4566-9029-bcc77582e095 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:10.444573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4bc1c-0b29-4566-9029-bcc77582e095 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:10.444872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4bc1c-0b29-4566-9029-bcc77582e095 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:10.457364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4bc1c-0b29-4566-9029-bcc77582e095 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:10.463596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-bde4bc1c-0b29-4566-9029-bcc77582e095 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:10.464668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 81/163] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:10.470219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd23fdf-653b-4cff-9817-71dc410ae2d3 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:10.478667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd23fdf-653b-4cff-9817-71dc410ae2d3 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:10.482539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea7f3-eba8-41da-a5b2-3fccc1a5fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:10.483746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea7f3-eba8-41da-a5b2-3fccc1a5fcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:10.484090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea7f3-eba8-41da-a5b2-3fccc1a5fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:10.484369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea7f3-eba8-41da-a5b2-3fccc1a5fcd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:10.485063 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ea7f3-eba8-41da-a5b2-3fccc1a5fcd4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:10.485357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ea7f3-eba8-41da-a5b2-3fccc1a5fcd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:10.511746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ea7f3-eba8-41da-a5b2-3fccc1a5fcd4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:10.521637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 83/164] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:10.527480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4bc1c-0b29-4566-9029-bcc77582e095 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:10.537689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4bc1c-0b29-4566-9029-bcc77582e095 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:10.541677 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5c975-4109-45be-82d8-2b4106de3a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:10.542466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5c975-4109-45be-82d8-2b4106de3a8a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:10.542754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5c975-4109-45be-82d8-2b4106de3a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:10.543035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5c975-4109-45be-82d8-2b4106de3a8a admin admin] PATH_INFO: `/v3/users/80d94a60f9304f468fc1b26f4c68b6be` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:10.570060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5c975-4109-45be-82d8-2b4106de3a8a admin admin] RBAC: Authorizing `identity:get_user(user_id=80d94a60f9304f468fc1b26f4c68b6be)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:10.596963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5c975-4109-45be-82d8-2b4106de3a8a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:10.598551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 82/165] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:10 2022] GET /identity/v3/users/80d94a60f9304f468fc1b26f4c68b6be => generated 283 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:10.604197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea7f3-eba8-41da-a5b2-3fccc1a5fcd4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:10.614232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea7f3-eba8-41da-a5b2-3fccc1a5fcd4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:10.618251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded680f-aace-46a7-9235-7531c84ba5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:10.618763 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded680f-aace-46a7-9235-7531c84ba5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:10.619050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded680f-aace-46a7-9235-7531c84ba5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:10.619358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded680f-aace-46a7-9235-7531c84ba5c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:10.627637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded680f-aace-46a7-9235-7531c84ba5c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:10.653311 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded680f-aace-46a7-9235-7531c84ba5c6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:10.661776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 84/166] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:10 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:10.667545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5c975-4109-45be-82d8-2b4106de3a8a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:10.678012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5c975-4109-45be-82d8-2b4106de3a8a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:10.682098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e53395-1504-4d3a-85c6-cad9a613448a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:10.682954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e53395-1504-4d3a-85c6-cad9a613448a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:10.683273 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e53395-1504-4d3a-85c6-cad9a613448a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:10.683594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e53395-1504-4d3a-85c6-cad9a613448a admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:10.684662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e53395-1504-4d3a-85c6-cad9a613448a admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:10.711835 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e53395-1504-4d3a-85c6-cad9a613448a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:10.713359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 83/167] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:10 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:10.718934 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded680f-aace-46a7-9235-7531c84ba5c6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:10.727421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded680f-aace-46a7-9235-7531c84ba5c6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:10.731373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41bf85-55d6-4bd2-861e-9ccee46dcd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:10.731943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41bf85-55d6-4bd2-861e-9ccee46dcd00 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:10.732234 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41bf85-55d6-4bd2-861e-9ccee46dcd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:10.732517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41bf85-55d6-4bd2-861e-9ccee46dcd00 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:10.733822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41bf85-55d6-4bd2-861e-9ccee46dcd00 admin admin] RBAC: Adding query filter params (role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d, user.id=80d94a60f9304f468fc1b26f4c68b6be) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:10.734120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41bf85-55d6-4bd2-861e-9ccee46dcd00 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:10.760059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41bf85-55d6-4bd2-861e-9ccee46dcd00 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:10.765796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 85/168] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:38:10 2022] GET /identity/v3/role_assignments?user.id=80d94a60f9304f468fc1b26f4c68b6be&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:12.719537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55268b-81b6-4bce-8be4-cfb26c780dac None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:12.720081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55268b-81b6-4bce-8be4-cfb26c780dac None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:12.720081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55268b-81b6-4bce-8be4-cfb26c780dac None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:12.721771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 84/169] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:12.726835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7383adc-5285-4c1d-a79c-8e1091f2d43d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:12.727243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7383adc-5285-4c1d-a79c-8e1091f2d43d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:12.727437 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7383adc-5285-4c1d-a79c-8e1091f2d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:12.750955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e7383adc-5285-4c1d-a79c-8e1091f2d43d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:12.752119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e7383adc-5285-4c1d-a79c-8e1091f2d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:12.758763 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 86/170] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:12 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:12.780458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55268b-81b6-4bce-8be4-cfb26c780dac None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:12.792250 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55268b-81b6-4bce-8be4-cfb26c780dac None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:12.796733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160787ca-e771-4248-9e75-728db619b818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:12.797440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160787ca-e771-4248-9e75-728db619b818 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:12.797728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160787ca-e771-4248-9e75-728db619b818 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:12.798007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160787ca-e771-4248-9e75-728db619b818 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:12.809104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160787ca-e771-4248-9e75-728db619b818 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:12.816399 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-160787ca-e771-4248-9e75-728db619b818 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:12.817498 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 85/171] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:12.823262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7383adc-5285-4c1d-a79c-8e1091f2d43d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:12.832215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7383adc-5285-4c1d-a79c-8e1091f2d43d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:12.836236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85e55-f64d-4b35-8bd9-abf110c4fe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:12.836840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85e55-f64d-4b35-8bd9-abf110c4fe00 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:12.837126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85e55-f64d-4b35-8bd9-abf110c4fe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:12.837406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff85e55-f64d-4b35-8bd9-abf110c4fe00 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:12.838106 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff85e55-f64d-4b35-8bd9-abf110c4fe00 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:12.838402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff85e55-f64d-4b35-8bd9-abf110c4fe00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:12.864899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff85e55-f64d-4b35-8bd9-abf110c4fe00 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:12.874447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 87/172] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:12.880013 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160787ca-e771-4248-9e75-728db619b818 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:12.890582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160787ca-e771-4248-9e75-728db619b818 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:12.894555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3870e3-6eb2-4a0b-99fd-66527923b0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:12.895387 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3870e3-6eb2-4a0b-99fd-66527923b0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:12.895650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3870e3-6eb2-4a0b-99fd-66527923b0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:12.896032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3870e3-6eb2-4a0b-99fd-66527923b0d3 admin admin] PATH_INFO: `/v3/users/80d94a60f9304f468fc1b26f4c68b6be` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:12.897112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3870e3-6eb2-4a0b-99fd-66527923b0d3 admin admin] RBAC: Authorizing `identity:get_user(user_id=80d94a60f9304f468fc1b26f4c68b6be)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:12.924082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3870e3-6eb2-4a0b-99fd-66527923b0d3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:12.925555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 86/173] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:12 2022] GET /identity/v3/users/80d94a60f9304f468fc1b26f4c68b6be => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:12.930850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85e55-f64d-4b35-8bd9-abf110c4fe00 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:12.940761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff85e55-f64d-4b35-8bd9-abf110c4fe00 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:12.944726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ee544-60dd-4a2d-9a7a-727099b25c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:12.945493 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ee544-60dd-4a2d-9a7a-727099b25c40 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:12.945776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ee544-60dd-4a2d-9a7a-727099b25c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:12.946051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ee544-60dd-4a2d-9a7a-727099b25c40 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:12.947115 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ee544-60dd-4a2d-9a7a-727099b25c40 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:12.972788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ee544-60dd-4a2d-9a7a-727099b25c40 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:12.974234 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 88/174] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:12 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:12.979600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3870e3-6eb2-4a0b-99fd-66527923b0d3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:12.989419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3870e3-6eb2-4a0b-99fd-66527923b0d3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:12.993324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2b9b6-c583-4538-aa2c-84b01e2b44bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:12.994124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b9b6-c583-4538-aa2c-84b01e2b44bd admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:12.994412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b9b6-c583-4538-aa2c-84b01e2b44bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:12.994692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2b9b6-c583-4538-aa2c-84b01e2b44bd admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/users/80d94a60f9304f468fc1b26f4c68b6be/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:12.996415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2b9b6-c583-4538-aa2c-84b01e2b44bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d, user_id=80d94a60f9304f468fc1b26f4c68b6be, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:13.023208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2b9b6-c583-4538-aa2c-84b01e2b44bd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:13.093337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 87/175] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:38:12 2022] PUT /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/users/80d94a60f9304f468fc1b26f4c68b6be/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:38:15.086059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3938058-4cd6-416b-a572-a204be86d9f4 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:15.086563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3938058-4cd6-416b-a572-a204be86d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:15.086672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3938058-4cd6-416b-a572-a204be86d9f4 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:15.088444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 89/176] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:15.093684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9c415-c4ad-4b4d-8d08-e25fb9e9b9f9 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:15.094120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9c415-c4ad-4b4d-8d08-e25fb9e9b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:15.094248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9c415-c4ad-4b4d-8d08-e25fb9e9b9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:15.116889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ffc9c415-c4ad-4b4d-8d08-e25fb9e9b9f9 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:15.118024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ffc9c415-c4ad-4b4d-8d08-e25fb9e9b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:15.181894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 88/177] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:15 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:15.204852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3938058-4cd6-416b-a572-a204be86d9f4 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:15.216443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3938058-4cd6-416b-a572-a204be86d9f4 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:15.220271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71ff0-8f19-44c0-a59a-90daff6e6caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:15.220969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71ff0-8f19-44c0-a59a-90daff6e6caf admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:15.221253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71ff0-8f19-44c0-a59a-90daff6e6caf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:15.221582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71ff0-8f19-44c0-a59a-90daff6e6caf admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:15.233932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec71ff0-8f19-44c0-a59a-90daff6e6caf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:15.240283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-aec71ff0-8f19-44c0-a59a-90daff6e6caf admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:15.241348 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 90/178] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:15.246882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9c415-c4ad-4b4d-8d08-e25fb9e9b9f9 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:15.256404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9c415-c4ad-4b4d-8d08-e25fb9e9b9f9 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:15.260321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bed8d0-737a-4d99-83be-385dd3b59146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:15.260913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bed8d0-737a-4d99-83be-385dd3b59146 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:15.261202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bed8d0-737a-4d99-83be-385dd3b59146 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:15.261487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bed8d0-737a-4d99-83be-385dd3b59146 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:15.262198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bed8d0-737a-4d99-83be-385dd3b59146 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:15.262496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bed8d0-737a-4d99-83be-385dd3b59146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:15.288047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bed8d0-737a-4d99-83be-385dd3b59146 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:15.297118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 89/179] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:15.302727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71ff0-8f19-44c0-a59a-90daff6e6caf admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:15.312548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71ff0-8f19-44c0-a59a-90daff6e6caf admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:15.316456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b816bf-47dc-407c-8130-87e2a8debfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:15.317306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b816bf-47dc-407c-8130-87e2a8debfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:15.317524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b816bf-47dc-407c-8130-87e2a8debfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:15.317804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b816bf-47dc-407c-8130-87e2a8debfd4 admin admin] PATH_INFO: `/v3/users/80d94a60f9304f468fc1b26f4c68b6be` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:15.319127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b816bf-47dc-407c-8130-87e2a8debfd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=80d94a60f9304f468fc1b26f4c68b6be)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:15.345820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b816bf-47dc-407c-8130-87e2a8debfd4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:15.347221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 91/180] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:15 2022] GET /identity/v3/users/80d94a60f9304f468fc1b26f4c68b6be => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:15.352405 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bed8d0-737a-4d99-83be-385dd3b59146 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:15.361817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bed8d0-737a-4d99-83be-385dd3b59146 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:15.365707 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf381-3b14-4ae4-9b68-abc199c309a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:15.366277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf381-3b14-4ae4-9b68-abc199c309a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:15.366564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf381-3b14-4ae4-9b68-abc199c309a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:15.366848 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf381-3b14-4ae4-9b68-abc199c309a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:15.375028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf381-3b14-4ae4-9b68-abc199c309a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:15.400822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf381-3b14-4ae4-9b68-abc199c309a1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:15.409183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 90/181] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:15 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:15.414848 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b816bf-47dc-407c-8130-87e2a8debfd4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:15.424279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b816bf-47dc-407c-8130-87e2a8debfd4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:15.428129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360a8a8-3013-4c67-9827-3dd3824562d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:15.428950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360a8a8-3013-4c67-9827-3dd3824562d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:15.429237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360a8a8-3013-4c67-9827-3dd3824562d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:15.429516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360a8a8-3013-4c67-9827-3dd3824562d0 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:15.430649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360a8a8-3013-4c67-9827-3dd3824562d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:15.457602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f360a8a8-3013-4c67-9827-3dd3824562d0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:15.459130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 92/182] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:15 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:15.464652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf381-3b14-4ae4-9b68-abc199c309a1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:15.473287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf381-3b14-4ae4-9b68-abc199c309a1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:15.477192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da7868-974b-408c-b5ed-b3112dda8035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:15.477758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7868-974b-408c-b5ed-b3112dda8035 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:15.478043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7868-974b-408c-b5ed-b3112dda8035 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:15.478322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da7868-974b-408c-b5ed-b3112dda8035 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:15.479095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da7868-974b-408c-b5ed-b3112dda8035 admin admin] RBAC: Adding query filter params (role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d, user.id=80d94a60f9304f468fc1b26f4c68b6be) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:15.479436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da7868-974b-408c-b5ed-b3112dda8035 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:15.506128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da7868-974b-408c-b5ed-b3112dda8035 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:15.512467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 91/183] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:38:15 2022] GET /identity/v3/role_assignments?user.id=80d94a60f9304f468fc1b26f4c68b6be&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:17.534980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4d25-e31c-451d-b9c4-107c4d915b59 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:17.535555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4d25-e31c-451d-b9c4-107c4d915b59 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:17.535555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e4d25-e31c-451d-b9c4-107c4d915b59 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:17.537489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 93/184] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:17.542681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbf12-5e24-41da-8642-d6e00e09dd0d None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:17.543094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbf12-5e24-41da-8642-d6e00e09dd0d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:17.543265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecbf12-5e24-41da-8642-d6e00e09dd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:17.572626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-edecbf12-5e24-41da-8642-d6e00e09dd0d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:17.573764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-edecbf12-5e24-41da-8642-d6e00e09dd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:17.581191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 92/185] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:17 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:17.606338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4d25-e31c-451d-b9c4-107c4d915b59 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:17.619032 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e4d25-e31c-451d-b9c4-107c4d915b59 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:17.622856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71399b4e-d768-4235-b31c-6a92b47623dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:17.624142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71399b4e-d768-4235-b31c-6a92b47623dc admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:17.624504 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71399b4e-d768-4235-b31c-6a92b47623dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:17.624791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71399b4e-d768-4235-b31c-6a92b47623dc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:17.635771 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71399b4e-d768-4235-b31c-6a92b47623dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:17.646561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-71399b4e-d768-4235-b31c-6a92b47623dc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:38:17.647807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 94/186] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:17.653587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbf12-5e24-41da-8642-d6e00e09dd0d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:17.662573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecbf12-5e24-41da-8642-d6e00e09dd0d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:17.666529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5be3c-97ee-4f0f-bdc4-589645077352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:17.667124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5be3c-97ee-4f0f-bdc4-589645077352 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:17.667515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5be3c-97ee-4f0f-bdc4-589645077352 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:17.667799 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5be3c-97ee-4f0f-bdc4-589645077352 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:17.668511 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5be3c-97ee-4f0f-bdc4-589645077352 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:17.668813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5be3c-97ee-4f0f-bdc4-589645077352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:17.694443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5be3c-97ee-4f0f-bdc4-589645077352 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:17.704091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 93/187] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:17.709787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71399b4e-d768-4235-b31c-6a92b47623dc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:17.720404 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71399b4e-d768-4235-b31c-6a92b47623dc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:17.724240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bafdd-d87f-4082-a6f5-480881f80b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:17.725024 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bafdd-d87f-4082-a6f5-480881f80b41 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:17.725309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bafdd-d87f-4082-a6f5-480881f80b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:17.725586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bafdd-d87f-4082-a6f5-480881f80b41 admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:17.726653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bafdd-d87f-4082-a6f5-480881f80b41 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:17.752608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bafdd-d87f-4082-a6f5-480881f80b41 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:17.754074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 95/188] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:17 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:17.759380 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5be3c-97ee-4f0f-bdc4-589645077352 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:17.769261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5be3c-97ee-4f0f-bdc4-589645077352 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:17.773184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb849d93-18bc-4975-9bed-b196e5a2027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:17.773749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849d93-18bc-4975-9bed-b196e5a2027d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:17.774038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849d93-18bc-4975-9bed-b196e5a2027d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:17.774321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb849d93-18bc-4975-9bed-b196e5a2027d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:17.781963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb849d93-18bc-4975-9bed-b196e5a2027d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:17.807616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb849d93-18bc-4975-9bed-b196e5a2027d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:17.816938 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 94/189] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:17 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:17.822392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bafdd-d87f-4082-a6f5-480881f80b41 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:17.832995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bafdd-d87f-4082-a6f5-480881f80b41 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:17.837008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55348f-74de-4bed-b1d2-566c1b22c56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:17.837789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55348f-74de-4bed-b1d2-566c1b22c56c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:17.838079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55348f-74de-4bed-b1d2-566c1b22c56c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:17.838383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55348f-74de-4bed-b1d2-566c1b22c56c admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:17.839474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55348f-74de-4bed-b1d2-566c1b22c56c admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:17.866014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55348f-74de-4bed-b1d2-566c1b22c56c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:17.867589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 96/190] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:17 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:17.874212 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb849d93-18bc-4975-9bed-b196e5a2027d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:17.882883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb849d93-18bc-4975-9bed-b196e5a2027d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:17.886835 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71418f85-b4fd-43aa-97e6-4c550605248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:17.887465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71418f85-b4fd-43aa-97e6-4c550605248e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:17.887744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71418f85-b4fd-43aa-97e6-4c550605248e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:17.888028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71418f85-b4fd-43aa-97e6-4c550605248e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:17.888808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71418f85-b4fd-43aa-97e6-4c550605248e admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d, user.id=4b6ba909638e4d95a0827152d2079014) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:17.890209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71418f85-b4fd-43aa-97e6-4c550605248e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:17.916526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71418f85-b4fd-43aa-97e6-4c550605248e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:17.922840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 95/191] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:38:17 2022] GET /identity/v3/role_assignments?user.id=4b6ba909638e4d95a0827152d2079014&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:19.890486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc03aa-e8ec-495d-8d07-22a0004edc86 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:19.891038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc03aa-e8ec-495d-8d07-22a0004edc86 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:19.891038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc03aa-e8ec-495d-8d07-22a0004edc86 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:19.892743 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 97/192] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:19.897808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96225964-6d4c-40e4-a917-55544882f0c2 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:19.898215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96225964-6d4c-40e4-a917-55544882f0c2 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:19.898378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96225964-6d4c-40e4-a917-55544882f0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:19.922637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-96225964-6d4c-40e4-a917-55544882f0c2 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:19.923814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-96225964-6d4c-40e4-a917-55544882f0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:19.930540 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 96/193] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:19 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:19.952289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc03aa-e8ec-495d-8d07-22a0004edc86 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:19.964785 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc03aa-e8ec-495d-8d07-22a0004edc86 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:19.969183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657f6ac-c3ea-4dbb-87f2-e1664dd04687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:19.969885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657f6ac-c3ea-4dbb-87f2-e1664dd04687 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:19.970174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657f6ac-c3ea-4dbb-87f2-e1664dd04687 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:19.970457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657f6ac-c3ea-4dbb-87f2-e1664dd04687 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:19.981586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657f6ac-c3ea-4dbb-87f2-e1664dd04687 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:19.988618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-c657f6ac-c3ea-4dbb-87f2-e1664dd04687 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:38:19.989713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 98/194] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:38:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:19.995451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96225964-6d4c-40e4-a917-55544882f0c2 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:20.004194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96225964-6d4c-40e4-a917-55544882f0c2 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:20.008119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7847ec-d68f-4d71-8a3e-d3a5f34ce4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:20.008701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7847ec-d68f-4d71-8a3e-d3a5f34ce4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:20.008984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7847ec-d68f-4d71-8a3e-d3a5f34ce4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:20.009262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7847ec-d68f-4d71-8a3e-d3a5f34ce4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:20.009978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7847ec-d68f-4d71-8a3e-d3a5f34ce4f6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:20.010278 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7847ec-d68f-4d71-8a3e-d3a5f34ce4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:20.036402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7847ec-d68f-4d71-8a3e-d3a5f34ce4f6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:20.045418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 97/195] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:20.050725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657f6ac-c3ea-4dbb-87f2-e1664dd04687 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:20.061529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657f6ac-c3ea-4dbb-87f2-e1664dd04687 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:20.065542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c2003-f8c4-4c51-979c-c216b2285883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:20.066320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c2003-f8c4-4c51-979c-c216b2285883 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:20.066610 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c2003-f8c4-4c51-979c-c216b2285883 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:20.066888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c2003-f8c4-4c51-979c-c216b2285883 admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:20.067987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c2003-f8c4-4c51-979c-c216b2285883 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:20.095685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0c2003-f8c4-4c51-979c-c216b2285883 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:20.095685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 99/196] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:20 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:20.100448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7847ec-d68f-4d71-8a3e-d3a5f34ce4f6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:20.110959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7847ec-d68f-4d71-8a3e-d3a5f34ce4f6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:20.115046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bfe47-a74b-49d1-a132-f47734460ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:20.115856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bfe47-a74b-49d1-a132-f47734460ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:20.116148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bfe47-a74b-49d1-a132-f47734460ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:20.116432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bfe47-a74b-49d1-a132-f47734460ba4 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:20.117509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bfe47-a74b-49d1-a132-f47734460ba4 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:20.144739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bfe47-a74b-49d1-a132-f47734460ba4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:20.146174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 98/197] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:20 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:20.151631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c2003-f8c4-4c51-979c-c216b2285883 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:20.161359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c2003-f8c4-4c51-979c-c216b2285883 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:20.165533 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347158c-2560-4631-8fd2-b69717cb640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:20.166327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347158c-2560-4631-8fd2-b69717cb640e admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:20.166616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347158c-2560-4631-8fd2-b69717cb640e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:20.166896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347158c-2560-4631-8fd2-b69717cb640e admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/users/4b6ba909638e4d95a0827152d2079014/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:20.168651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347158c-2560-4631-8fd2-b69717cb640e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d, user_id=4b6ba909638e4d95a0827152d2079014, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:20.195630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347158c-2560-4631-8fd2-b69717cb640e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:20.316217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 100/198] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:38:20 2022] PUT /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/users/4b6ba909638e4d95a0827152d2079014/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:38:22.275455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b99e2-6b16-429d-a274-58350b665126 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:22.275959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b99e2-6b16-429d-a274-58350b665126 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:22.276081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b99e2-6b16-429d-a274-58350b665126 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:22.277679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 99/199] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:22.283431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62c27-6904-4564-be83-d37888b971ca None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:22.283842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62c27-6904-4564-be83-d37888b971ca None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:22.284003 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62c27-6904-4564-be83-d37888b971ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:22.307101 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c2b62c27-6904-4564-be83-d37888b971ca None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:22.308254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c2b62c27-6904-4564-be83-d37888b971ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:22.372762 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 101/200] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:22 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:22.394905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b99e2-6b16-429d-a274-58350b665126 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:22.406999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b99e2-6b16-429d-a274-58350b665126 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:22.410793 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c046b2-88d8-45b4-9911-707f7b0119a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:22.411530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c046b2-88d8-45b4-9911-707f7b0119a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:22.411820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c046b2-88d8-45b4-9911-707f7b0119a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:22.412354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c046b2-88d8-45b4-9911-707f7b0119a3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:22.424956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c046b2-88d8-45b4-9911-707f7b0119a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:22.431223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-98c046b2-88d8-45b4-9911-707f7b0119a3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:38:22.432348 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 100/201] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:22.438040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b62c27-6904-4564-be83-d37888b971ca None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:22.446642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b62c27-6904-4564-be83-d37888b971ca None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:22.450641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e50793-580f-4fe6-8ed4-e0b274f9d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:22.451227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e50793-580f-4fe6-8ed4-e0b274f9d724 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:22.451545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e50793-580f-4fe6-8ed4-e0b274f9d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:22.451829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e50793-580f-4fe6-8ed4-e0b274f9d724 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:22.453136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e50793-580f-4fe6-8ed4-e0b274f9d724 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:22.453435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e50793-580f-4fe6-8ed4-e0b274f9d724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:22.479148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e50793-580f-4fe6-8ed4-e0b274f9d724 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:22.487767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 102/202] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:22.493270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c046b2-88d8-45b4-9911-707f7b0119a3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:22.502591 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c046b2-88d8-45b4-9911-707f7b0119a3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:22.506684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b1ea5-b6b6-4ca7-9f35-86c514860d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:22.507523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b1ea5-b6b6-4ca7-9f35-86c514860d76 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:22.507816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b1ea5-b6b6-4ca7-9f35-86c514860d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:22.508101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b1ea5-b6b6-4ca7-9f35-86c514860d76 admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:22.509187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b1ea5-b6b6-4ca7-9f35-86c514860d76 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:22.535751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b1ea5-b6b6-4ca7-9f35-86c514860d76 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:22.537538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 101/203] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:22 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:22.543068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e50793-580f-4fe6-8ed4-e0b274f9d724 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:22.552683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e50793-580f-4fe6-8ed4-e0b274f9d724 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:22.556623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf9622-78fd-433e-b7af-3594d16b441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:22.557194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf9622-78fd-433e-b7af-3594d16b441b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:22.557484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf9622-78fd-433e-b7af-3594d16b441b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:22.557767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf9622-78fd-433e-b7af-3594d16b441b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:22.565644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf9622-78fd-433e-b7af-3594d16b441b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:22.591344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf9622-78fd-433e-b7af-3594d16b441b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:22.600360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 103/204] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:22 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:22.605872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b1ea5-b6b6-4ca7-9f35-86c514860d76 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:22.615011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b1ea5-b6b6-4ca7-9f35-86c514860d76 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:22.618973 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e8931-8036-4a59-8871-c907cdb32d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:22.619781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e8931-8036-4a59-8871-c907cdb32d3a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:22.620127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e8931-8036-4a59-8871-c907cdb32d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:22.620410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e8931-8036-4a59-8871-c907cdb32d3a admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:22.621458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e8931-8036-4a59-8871-c907cdb32d3a admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:22.647900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e8931-8036-4a59-8871-c907cdb32d3a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:22.649422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 102/205] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:22 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:22.655203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf9622-78fd-433e-b7af-3594d16b441b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:22.665285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf9622-78fd-433e-b7af-3594d16b441b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:22.669274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6059cd-d81c-464c-a792-2e0aff47a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:22.669849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6059cd-d81c-464c-a792-2e0aff47a482 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:22.670143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6059cd-d81c-464c-a792-2e0aff47a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:22.670431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6059cd-d81c-464c-a792-2e0aff47a482 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:22.672233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6059cd-d81c-464c-a792-2e0aff47a482 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d, user.id=4b6ba909638e4d95a0827152d2079014) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:22.672547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6059cd-d81c-464c-a792-2e0aff47a482 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:22.698947 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6059cd-d81c-464c-a792-2e0aff47a482 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:22.705489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 104/206] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:38:22 2022] GET /identity/v3/role_assignments?user.id=4b6ba909638e4d95a0827152d2079014&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:24.746369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b24efc-2a43-458d-83c8-574245689b4e None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:24.746887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b24efc-2a43-458d-83c8-574245689b4e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:24.746887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b24efc-2a43-458d-83c8-574245689b4e None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:24.748609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 103/207] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:24.754069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac42e1-23d1-4e22-a5ff-6e2574c827fc None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:24.754545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac42e1-23d1-4e22-a5ff-6e2574c827fc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:24.754638 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac42e1-23d1-4e22-a5ff-6e2574c827fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:24.777203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-ddac42e1-23d1-4e22-a5ff-6e2574c827fc None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:24.778334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ddac42e1-23d1-4e22-a5ff-6e2574c827fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:24.785686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 105/208] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:24 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:24.807530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b24efc-2a43-458d-83c8-574245689b4e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:24.818864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b24efc-2a43-458d-83c8-574245689b4e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:24.822616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d04852-2dca-43b2-aa0e-fb0383fa8573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:24.823363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d04852-2dca-43b2-aa0e-fb0383fa8573 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:24.823650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d04852-2dca-43b2-aa0e-fb0383fa8573 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:24.823928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d04852-2dca-43b2-aa0e-fb0383fa8573 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:24.835482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d04852-2dca-43b2-aa0e-fb0383fa8573 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:24.841961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-52d04852-2dca-43b2-aa0e-fb0383fa8573 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:38:24.843995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 104/209] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:38:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:38:24.849379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac42e1-23d1-4e22-a5ff-6e2574c827fc None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:24.858011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac42e1-23d1-4e22-a5ff-6e2574c827fc None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:24.862011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99641497-bb9f-47e1-a9cd-d656a07868f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:24.862601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99641497-bb9f-47e1-a9cd-d656a07868f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:24.862889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99641497-bb9f-47e1-a9cd-d656a07868f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:24.863173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99641497-bb9f-47e1-a9cd-d656a07868f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:24.863917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99641497-bb9f-47e1-a9cd-d656a07868f1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:24.864220 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99641497-bb9f-47e1-a9cd-d656a07868f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:24.889361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99641497-bb9f-47e1-a9cd-d656a07868f1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:24.898261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 106/210] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:38:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:24.903997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d04852-2dca-43b2-aa0e-fb0383fa8573 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:24.916660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d04852-2dca-43b2-aa0e-fb0383fa8573 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:24.920553 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8070c6-a8cc-4ee4-810e-b2818f33dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:24.921599 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8070c6-a8cc-4ee4-810e-b2818f33dc8e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:24.921945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8070c6-a8cc-4ee4-810e-b2818f33dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:24.922229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8070c6-a8cc-4ee4-810e-b2818f33dc8e admin admin] PATH_INFO: `/v3/users/80d94a60f9304f468fc1b26f4c68b6be` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:24.923332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8070c6-a8cc-4ee4-810e-b2818f33dc8e admin admin] RBAC: Authorizing `identity:get_user(user_id=80d94a60f9304f468fc1b26f4c68b6be)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:24.948659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8070c6-a8cc-4ee4-810e-b2818f33dc8e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:24.950119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 105/211] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:24 2022] GET /identity/v3/users/80d94a60f9304f468fc1b26f4c68b6be => generated 283 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:24.956069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99641497-bb9f-47e1-a9cd-d656a07868f1 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:24.965325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99641497-bb9f-47e1-a9cd-d656a07868f1 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:24.969875 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e155662-96de-4f2b-bc28-64f9ca08abe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:24.970440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155662-96de-4f2b-bc28-64f9ca08abe7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:24.970734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155662-96de-4f2b-bc28-64f9ca08abe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:24.971016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e155662-96de-4f2b-bc28-64f9ca08abe7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:24.978569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e155662-96de-4f2b-bc28-64f9ca08abe7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:25.004346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e155662-96de-4f2b-bc28-64f9ca08abe7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:25.012720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 107/212] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:24 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:25.019023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8070c6-a8cc-4ee4-810e-b2818f33dc8e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:25.028265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8070c6-a8cc-4ee4-810e-b2818f33dc8e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:25.032792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db49615-269f-412a-9bf2-f652536ce813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:25.033556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db49615-269f-412a-9bf2-f652536ce813 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:25.033839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db49615-269f-412a-9bf2-f652536ce813 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:25.034145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db49615-269f-412a-9bf2-f652536ce813 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:25.035190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db49615-269f-412a-9bf2-f652536ce813 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:25.060963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db49615-269f-412a-9bf2-f652536ce813 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:25.063088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 106/213] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:25 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:25.068694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e155662-96de-4f2b-bc28-64f9ca08abe7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:25.077161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e155662-96de-4f2b-bc28-64f9ca08abe7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:25.081737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f0d82-d839-4b03-8c1f-8927c4ed16ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:25.082304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0d82-d839-4b03-8c1f-8927c4ed16ea admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:25.082593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0d82-d839-4b03-8c1f-8927c4ed16ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:25.082872 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f0d82-d839-4b03-8c1f-8927c4ed16ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:25.083666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f0d82-d839-4b03-8c1f-8927c4ed16ea admin admin] RBAC: Adding query filter params (role.id=3876294260db4719972a530e23d90b2f, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d, user.id=80d94a60f9304f468fc1b26f4c68b6be) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:25.083965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f0d82-d839-4b03-8c1f-8927c4ed16ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:25.109881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f0d82-d839-4b03-8c1f-8927c4ed16ea admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:25.115674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 108/214] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:38:25 2022] GET /identity/v3/role_assignments?user.id=80d94a60f9304f468fc1b26f4c68b6be&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=3876294260db4719972a530e23d90b2f => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:27.101125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6424c4-7c86-4a75-8731-a9285a40c8c8 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:27.101541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6424c4-7c86-4a75-8731-a9285a40c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:27.101681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6424c4-7c86-4a75-8731-a9285a40c8c8 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:27.103440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 107/215] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:27.109138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422b81-64df-408e-92b9-0239a7b0a18d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:27.109512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422b81-64df-408e-92b9-0239a7b0a18d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:27.109713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422b81-64df-408e-92b9-0239a7b0a18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:27.132468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-98422b81-64df-408e-92b9-0239a7b0a18d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:27.133603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-98422b81-64df-408e-92b9-0239a7b0a18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:27.140736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 109/216] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:27 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:27.162669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6424c4-7c86-4a75-8731-a9285a40c8c8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:27.174638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6424c4-7c86-4a75-8731-a9285a40c8c8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:27.178379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886b62d-66f2-4b02-a33b-713b9e04071f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:27.179092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886b62d-66f2-4b02-a33b-713b9e04071f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:27.179410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886b62d-66f2-4b02-a33b-713b9e04071f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:27.179690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886b62d-66f2-4b02-a33b-713b9e04071f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:27.191206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7886b62d-66f2-4b02-a33b-713b9e04071f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:27.197812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-7886b62d-66f2-4b02-a33b-713b9e04071f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:38:27.198950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 108/217] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:38:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:27.204879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422b81-64df-408e-92b9-0239a7b0a18d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:27.213369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422b81-64df-408e-92b9-0239a7b0a18d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:27.217404 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcdd65-652f-4743-90bc-a9d221d19139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:27.217985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcdd65-652f-4743-90bc-a9d221d19139 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:27.218435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcdd65-652f-4743-90bc-a9d221d19139 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:27.218729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcdd65-652f-4743-90bc-a9d221d19139 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:27.219469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcdd65-652f-4743-90bc-a9d221d19139 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:27.219775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcdd65-652f-4743-90bc-a9d221d19139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:27.245617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcdd65-652f-4743-90bc-a9d221d19139 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:27.254658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 110/218] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:38:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:27.260196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886b62d-66f2-4b02-a33b-713b9e04071f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:27.270995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886b62d-66f2-4b02-a33b-713b9e04071f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:27.274902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187344af-271a-4eda-9387-5b43167b7e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:27.275710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187344af-271a-4eda-9387-5b43167b7e56 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:27.275998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187344af-271a-4eda-9387-5b43167b7e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:27.276274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187344af-271a-4eda-9387-5b43167b7e56 admin admin] PATH_INFO: `/v3/users/80d94a60f9304f468fc1b26f4c68b6be` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:27.277346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187344af-271a-4eda-9387-5b43167b7e56 admin admin] RBAC: Authorizing `identity:get_user(user_id=80d94a60f9304f468fc1b26f4c68b6be)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:27.303543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187344af-271a-4eda-9387-5b43167b7e56 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:27.304998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 109/219] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:27 2022] GET /identity/v3/users/80d94a60f9304f468fc1b26f4c68b6be => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:27.310425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcdd65-652f-4743-90bc-a9d221d19139 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:27.320472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcdd65-652f-4743-90bc-a9d221d19139 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:27.324373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2643840e-ae03-42d9-9ee0-7d9d51174842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:27.325147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643840e-ae03-42d9-9ee0-7d9d51174842 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:27.325438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643840e-ae03-42d9-9ee0-7d9d51174842 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:27.325735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2643840e-ae03-42d9-9ee0-7d9d51174842 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:27.326817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643840e-ae03-42d9-9ee0-7d9d51174842 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:27.353132 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2643840e-ae03-42d9-9ee0-7d9d51174842 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:27.354623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 111/220] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:27 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:27.360769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187344af-271a-4eda-9387-5b43167b7e56 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:27.370300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187344af-271a-4eda-9387-5b43167b7e56 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:27.374875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2ff0f-c229-4d50-a7a5-e3e5ede011fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:27.375715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ff0f-c229-4d50-a7a5-e3e5ede011fe admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:27.376001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ff0f-c229-4d50-a7a5-e3e5ede011fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:27.376282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2ff0f-c229-4d50-a7a5-e3e5ede011fe admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/users/80d94a60f9304f468fc1b26f4c68b6be/roles/3876294260db4719972a530e23d90b2f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:27.378235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2ff0f-c229-4d50-a7a5-e3e5ede011fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d, user_id=80d94a60f9304f468fc1b26f4c68b6be, role_id=3876294260db4719972a530e23d90b2f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:27.404596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2ff0f-c229-4d50-a7a5-e3e5ede011fe admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:27.486286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 110/221] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:38:27 2022] PUT /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/users/80d94a60f9304f468fc1b26f4c68b6be/roles/3876294260db4719972a530e23d90b2f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 12:38:29.471427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce9923-37d9-43cf-aa6d-b9e486b4431f None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:29.471933 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce9923-37d9-43cf-aa6d-b9e486b4431f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:29.471933 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce9923-37d9-43cf-aa6d-b9e486b4431f None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:29.473589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 112/222] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:29.478658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e8860-c580-4656-9ad8-651dc639cd92 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:29.479051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e8860-c580-4656-9ad8-651dc639cd92 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:29.479215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e8860-c580-4656-9ad8-651dc639cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:29.502282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-272e8860-c580-4656-9ad8-651dc639cd92 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:29.503434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-272e8860-c580-4656-9ad8-651dc639cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:29.567378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 111/223] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:29.589412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce9923-37d9-43cf-aa6d-b9e486b4431f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:29.601812 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce9923-37d9-43cf-aa6d-b9e486b4431f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:29.605737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146bcf7-a0c8-427d-9b90-785bdf754975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:29.606469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146bcf7-a0c8-427d-9b90-785bdf754975 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:29.606757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146bcf7-a0c8-427d-9b90-785bdf754975 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:29.607040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146bcf7-a0c8-427d-9b90-785bdf754975 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:29.626715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146bcf7-a0c8-427d-9b90-785bdf754975 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:29.632887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-f146bcf7-a0c8-427d-9b90-785bdf754975 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:38:29.634002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 113/224] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:38:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:29.640142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e8860-c580-4656-9ad8-651dc639cd92 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:29.648723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e8860-c580-4656-9ad8-651dc639cd92 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:29.652641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e782b15-7d41-4a57-924c-2c379c8d4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:29.653228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e782b15-7d41-4a57-924c-2c379c8d4660 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:29.653508 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e782b15-7d41-4a57-924c-2c379c8d4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:29.653786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e782b15-7d41-4a57-924c-2c379c8d4660 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:29.654492 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e782b15-7d41-4a57-924c-2c379c8d4660 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:29.654786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e782b15-7d41-4a57-924c-2c379c8d4660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:29.681150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e782b15-7d41-4a57-924c-2c379c8d4660 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:29.689818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 112/225] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:38:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:29.695629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146bcf7-a0c8-427d-9b90-785bdf754975 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:29.705847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146bcf7-a0c8-427d-9b90-785bdf754975 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:29.709774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fd3c5-f2dc-44f7-9562-70bcf24442ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:29.710561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fd3c5-f2dc-44f7-9562-70bcf24442ba admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:29.710852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fd3c5-f2dc-44f7-9562-70bcf24442ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:29.711135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fd3c5-f2dc-44f7-9562-70bcf24442ba admin admin] PATH_INFO: `/v3/users/80d94a60f9304f468fc1b26f4c68b6be` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:29.712259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fd3c5-f2dc-44f7-9562-70bcf24442ba admin admin] RBAC: Authorizing `identity:get_user(user_id=80d94a60f9304f468fc1b26f4c68b6be)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:29.742611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fd3c5-f2dc-44f7-9562-70bcf24442ba admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:29.744137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 114/226] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:38:29 2022] GET /identity/v3/users/80d94a60f9304f468fc1b26f4c68b6be => generated 283 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:29.750147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e782b15-7d41-4a57-924c-2c379c8d4660 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:29.759571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e782b15-7d41-4a57-924c-2c379c8d4660 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:29.763555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526654ca-736e-4984-8496-506b05906eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:29.764137 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526654ca-736e-4984-8496-506b05906eac admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:29.764415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526654ca-736e-4984-8496-506b05906eac admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:29.765298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526654ca-736e-4984-8496-506b05906eac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:29.772924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526654ca-736e-4984-8496-506b05906eac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:29.802883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526654ca-736e-4984-8496-506b05906eac admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:29.812362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 113/227] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:29 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:29.817900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fd3c5-f2dc-44f7-9562-70bcf24442ba admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:29.827197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fd3c5-f2dc-44f7-9562-70bcf24442ba admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:29.831144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95946a01-8c52-4cd4-a826-90bd58bf41d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:29.831951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95946a01-8c52-4cd4-a826-90bd58bf41d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:29.832237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95946a01-8c52-4cd4-a826-90bd58bf41d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:29.832515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95946a01-8c52-4cd4-a826-90bd58bf41d5 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:29.833590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95946a01-8c52-4cd4-a826-90bd58bf41d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:29.860455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95946a01-8c52-4cd4-a826-90bd58bf41d5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:29.861988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 115/228] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:29 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:29.867816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526654ca-736e-4984-8496-506b05906eac admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:29.876557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526654ca-736e-4984-8496-506b05906eac admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:29.880523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149b5fe-635d-444a-b7d6-c6fbd1e8f588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:29.881090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149b5fe-635d-444a-b7d6-c6fbd1e8f588 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:29.881377 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149b5fe-635d-444a-b7d6-c6fbd1e8f588 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:29.881656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149b5fe-635d-444a-b7d6-c6fbd1e8f588 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:29.882423 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149b5fe-635d-444a-b7d6-c6fbd1e8f588 admin admin] RBAC: Adding query filter params (role.id=3876294260db4719972a530e23d90b2f, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d, user.id=80d94a60f9304f468fc1b26f4c68b6be) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:29.882721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149b5fe-635d-444a-b7d6-c6fbd1e8f588 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:29.908893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9149b5fe-635d-444a-b7d6-c6fbd1e8f588 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:29.914772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 114/229] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:38:29 2022] GET /identity/v3/role_assignments?user.id=80d94a60f9304f468fc1b26f4c68b6be&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=3876294260db4719972a530e23d90b2f => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:31.928263 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664da68-69ae-4693-a3e7-61409dbf0ddf None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:31.928810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664da68-69ae-4693-a3e7-61409dbf0ddf None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:31.928810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664da68-69ae-4693-a3e7-61409dbf0ddf None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:31.930479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 116/230] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:31.935526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feb881-7178-4661-836a-3d909d3232dc None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:31.935927 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feb881-7178-4661-836a-3d909d3232dc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:31.936096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8feb881-7178-4661-836a-3d909d3232dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:31.958980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c8feb881-7178-4661-836a-3d909d3232dc None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:31.960126 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c8feb881-7178-4661-836a-3d909d3232dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:31.966636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 115/231] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:31 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:31.987822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664da68-69ae-4693-a3e7-61409dbf0ddf None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:31.999575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664da68-69ae-4693-a3e7-61409dbf0ddf None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:32.003544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25152c-3f85-4238-a502-fb3cfbfaab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:32.004245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25152c-3f85-4238-a502-fb3cfbfaab07 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:32.004530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25152c-3f85-4238-a502-fb3cfbfaab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:32.004806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25152c-3f85-4238-a502-fb3cfbfaab07 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:32.005865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25152c-3f85-4238-a502-fb3cfbfaab07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:32.031870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25152c-3f85-4238-a502-fb3cfbfaab07 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:32.033321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 117/232] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:38:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:32.038971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feb881-7178-4661-836a-3d909d3232dc None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:32.047941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8feb881-7178-4661-836a-3d909d3232dc None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:32.051861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da8678-0553-44dc-82af-5b54b36dae74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:32.052447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da8678-0553-44dc-82af-5b54b36dae74 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:32.052732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da8678-0553-44dc-82af-5b54b36dae74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:32.053009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da8678-0553-44dc-82af-5b54b36dae74 admin admin] PATH_INFO: `/v3/groups` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:32.053630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da8678-0553-44dc-82af-5b54b36dae74 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:32.079241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-10da8678-0553-44dc-82af-5b54b36dae74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:38:32.079241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:38:32.079241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:38:32.080444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da8678-0553-44dc-82af-5b54b36dae74 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:32.159667 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 116/233] 10.222.0.87 () {60 vars in 1155 bytes} [Tue Jan 18 12:38:32 2022] POST /identity/v3/groups => generated 229 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:38:34.188531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35efa9-edac-4604-9aab-40775eac5714 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:34.189071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35efa9-edac-4604-9aab-40775eac5714 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:34.189161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35efa9-edac-4604-9aab-40775eac5714 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:34.190809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 118/234] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:34.195966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778093ff-a02e-4969-94c2-aa82e44d572d None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:34.196333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778093ff-a02e-4969-94c2-aa82e44d572d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:34.196527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778093ff-a02e-4969-94c2-aa82e44d572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:34.219303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-778093ff-a02e-4969-94c2-aa82e44d572d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:34.220448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-778093ff-a02e-4969-94c2-aa82e44d572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:34.226915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 117/235] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:34.249327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35efa9-edac-4604-9aab-40775eac5714 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:34.261260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35efa9-edac-4604-9aab-40775eac5714 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:34.265186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1113502-06c8-40f2-b3ad-d7afe1225a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:34.265890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1113502-06c8-40f2-b3ad-d7afe1225a97 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:34.266178 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1113502-06c8-40f2-b3ad-d7afe1225a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:34.266456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1113502-06c8-40f2-b3ad-d7afe1225a97 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:34.267545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1113502-06c8-40f2-b3ad-d7afe1225a97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:34.293714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1113502-06c8-40f2-b3ad-d7afe1225a97 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:34.295146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 119/236] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:38:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:34.301298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778093ff-a02e-4969-94c2-aa82e44d572d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:34.309878 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778093ff-a02e-4969-94c2-aa82e44d572d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:34.313829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a3f8b-c783-486a-9c4c-0f4ba30f9553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:34.314418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3f8b-c783-486a-9c4c-0f4ba30f9553 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:34.314709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3f8b-c783-486a-9c4c-0f4ba30f9553 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:34.314992 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3f8b-c783-486a-9c4c-0f4ba30f9553 admin admin] PATH_INFO: `/v3/groups` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:34.315672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a3f8b-c783-486a-9c4c-0f4ba30f9553 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:34.341238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a3f8b-c783-486a-9c4c-0f4ba30f9553 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:34.436144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 118/237] 10.222.0.87 () {60 vars in 1155 bytes} [Tue Jan 18 12:38:34 2022] POST /identity/v3/groups => generated 226 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:38:36.425874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcbdc8-2435-41a3-ac79-bc9bf2194ee3 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:36.426369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcbdc8-2435-41a3-ac79-bc9bf2194ee3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:36.426369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dcbdc8-2435-41a3-ac79-bc9bf2194ee3 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:36.428095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 120/238] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:36.433118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f182f6-8719-43f5-9d87-eb674da32d17 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:36.433494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f182f6-8719-43f5-9d87-eb674da32d17 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:36.433693 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f182f6-8719-43f5-9d87-eb674da32d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:36.456908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-01f182f6-8719-43f5-9d87-eb674da32d17 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:36.458035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-01f182f6-8719-43f5-9d87-eb674da32d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:36.464638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 119/239] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:36 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:36.486482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcbdc8-2435-41a3-ac79-bc9bf2194ee3 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:36.497976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dcbdc8-2435-41a3-ac79-bc9bf2194ee3 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:36.504760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b318510-374e-41d4-bb90-5bb49e074895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:36.505471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b318510-374e-41d4-bb90-5bb49e074895 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:36.505756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b318510-374e-41d4-bb90-5bb49e074895 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:36.506033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b318510-374e-41d4-bb90-5bb49e074895 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:36.518717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b318510-374e-41d4-bb90-5bb49e074895 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:36.525032 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-3b318510-374e-41d4-bb90-5bb49e074895 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:36.526118 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 121/240] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:36.532268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f182f6-8719-43f5-9d87-eb674da32d17 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:36.541117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f182f6-8719-43f5-9d87-eb674da32d17 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:36.545062 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288011fb-d2e5-4e08-ad57-0a343793715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:36.545758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288011fb-d2e5-4e08-ad57-0a343793715a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:36.546047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288011fb-d2e5-4e08-ad57-0a343793715a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:36.546325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288011fb-d2e5-4e08-ad57-0a343793715a admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:36.547034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288011fb-d2e5-4e08-ad57-0a343793715a admin admin] RBAC: Adding query filter params (name=member) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:36.547362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288011fb-d2e5-4e08-ad57-0a343793715a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:36.573226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288011fb-d2e5-4e08-ad57-0a343793715a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:36.582895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 120/241] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:36.588645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b318510-374e-41d4-bb90-5bb49e074895 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:36.597968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b318510-374e-41d4-bb90-5bb49e074895 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:36.602202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc40860-10aa-4959-8e93-b20cd5a5f59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:36.602769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc40860-10aa-4959-8e93-b20cd5a5f59d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:36.603059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc40860-10aa-4959-8e93-b20cd5a5f59d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:36.603371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc40860-10aa-4959-8e93-b20cd5a5f59d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:36.611191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc40860-10aa-4959-8e93-b20cd5a5f59d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:36.637117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc40860-10aa-4959-8e93-b20cd5a5f59d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:36.653706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 122/242] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:36 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:36.659453 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288011fb-d2e5-4e08-ad57-0a343793715a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:36.668907 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288011fb-d2e5-4e08-ad57-0a343793715a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:36.672940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e278665-186c-48c8-8337-ab671fad511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:36.673711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e278665-186c-48c8-8337-ab671fad511f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:36.673996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e278665-186c-48c8-8337-ab671fad511f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:36.674275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e278665-186c-48c8-8337-ab671fad511f admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:36.675365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e278665-186c-48c8-8337-ab671fad511f admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:36.701325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e278665-186c-48c8-8337-ab671fad511f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:36.703449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 121/243] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:36 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:36.708782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc40860-10aa-4959-8e93-b20cd5a5f59d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:36.717496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc40860-10aa-4959-8e93-b20cd5a5f59d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:36.722799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed243b4-70aa-4dbf-8a5c-9cb76be54fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:36.723610 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed243b4-70aa-4dbf-8a5c-9cb76be54fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:36.723903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed243b4-70aa-4dbf-8a5c-9cb76be54fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:36.724185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed243b4-70aa-4dbf-8a5c-9cb76be54fc9 admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:36.729364 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed243b4-70aa-4dbf-8a5c-9cb76be54fc9 admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:36.755231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-1ed243b4-70aa-4dbf-8a5c-9cb76be54fc9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:38:36.755231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:38:36.755231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:38:36.756434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed243b4-70aa-4dbf-8a5c-9cb76be54fc9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:36.757995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 123/244] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:36 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:36.763748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e278665-186c-48c8-8337-ab671fad511f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:36.773143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e278665-186c-48c8-8337-ab671fad511f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:36.777005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35fd7d-b892-4256-9b15-34b2e0eec828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:36.777579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35fd7d-b892-4256-9b15-34b2e0eec828 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:36.777864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35fd7d-b892-4256-9b15-34b2e0eec828 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:36.778144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35fd7d-b892-4256-9b15-34b2e0eec828 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:36.778919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35fd7d-b892-4256-9b15-34b2e0eec828 admin admin] RBAC: Adding query filter params (group.id=3bff9f4b0d4444ad80a377104104cb63, role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=6989cbd135d744de861fa22cace1177a) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:36.779219 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35fd7d-b892-4256-9b15-34b2e0eec828 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:36.806015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35fd7d-b892-4256-9b15-34b2e0eec828 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:36.812374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 122/245] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:38:36 2022] GET /identity/v3/role_assignments?group.id=3bff9f4b0d4444ad80a377104104cb63&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:38.777116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc4323-4696-42fa-b5ec-d1d28bda2d2c None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:38.777687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc4323-4696-42fa-b5ec-d1d28bda2d2c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:38.777687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc4323-4696-42fa-b5ec-d1d28bda2d2c None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:38.779376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 124/246] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:38.784672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3d059-610c-4c02-b0aa-c747984ff3d1 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:38.785085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3d059-610c-4c02-b0aa-c747984ff3d1 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:38.785275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3d059-610c-4c02-b0aa-c747984ff3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:38.807526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d8f3d059-610c-4c02-b0aa-c747984ff3d1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:38.808636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d8f3d059-610c-4c02-b0aa-c747984ff3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:38.815820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 123/247] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:38 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:38.838257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc4323-4696-42fa-b5ec-d1d28bda2d2c None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:38.849872 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc4323-4696-42fa-b5ec-d1d28bda2d2c None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:38.853698 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb95e-b868-462a-84d6-bc825b587875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:38.854410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb95e-b868-462a-84d6-bc825b587875 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:38.854698 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb95e-b868-462a-84d6-bc825b587875 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:38.854977 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666bb95e-b868-462a-84d6-bc825b587875 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:38.865882 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666bb95e-b868-462a-84d6-bc825b587875 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:38.872228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-666bb95e-b868-462a-84d6-bc825b587875 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:38.873796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 125/248] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:38.879660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3d059-610c-4c02-b0aa-c747984ff3d1 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:38.888451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3d059-610c-4c02-b0aa-c747984ff3d1 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:38.893025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6940ede-a11e-4170-9d5e-188f3cbb07a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:38.893616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6940ede-a11e-4170-9d5e-188f3cbb07a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:38.893903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6940ede-a11e-4170-9d5e-188f3cbb07a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:38.894187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6940ede-a11e-4170-9d5e-188f3cbb07a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:38.894896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6940ede-a11e-4170-9d5e-188f3cbb07a8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:38.895197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6940ede-a11e-4170-9d5e-188f3cbb07a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:38.920967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6940ede-a11e-4170-9d5e-188f3cbb07a8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:38.929612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 124/249] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:38.935062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb95e-b868-462a-84d6-bc825b587875 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:38.946267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666bb95e-b868-462a-84d6-bc825b587875 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:38.950281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902410a-146b-481d-8e90-97080496fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:38.951050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902410a-146b-481d-8e90-97080496fbdc admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:38.951370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902410a-146b-481d-8e90-97080496fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:38.952649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902410a-146b-481d-8e90-97080496fbdc admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:38.953727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902410a-146b-481d-8e90-97080496fbdc admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:38.979551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902410a-146b-481d-8e90-97080496fbdc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:38.980994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 126/250] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:38 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:38.986880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6940ede-a11e-4170-9d5e-188f3cbb07a8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:38.996032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6940ede-a11e-4170-9d5e-188f3cbb07a8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:39.000639 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64a760-000f-4278-a879-34adefe55cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:39.001453 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64a760-000f-4278-a879-34adefe55cfd admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:39.001778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64a760-000f-4278-a879-34adefe55cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:39.002099 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64a760-000f-4278-a879-34adefe55cfd admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:39.003195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64a760-000f-4278-a879-34adefe55cfd admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:39.028719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64a760-000f-4278-a879-34adefe55cfd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:39.030403 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 125/251] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:38 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:39.035838 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902410a-146b-481d-8e90-97080496fbdc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:39.046064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902410a-146b-481d-8e90-97080496fbdc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:39.049982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27194d1d-33f9-4ad3-a691-9456b436f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:39.050811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194d1d-33f9-4ad3-a691-9456b436f104 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:39.051101 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194d1d-33f9-4ad3-a691-9456b436f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:39.051410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194d1d-33f9-4ad3-a691-9456b436f104 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a/groups/3bff9f4b0d4444ad80a377104104cb63/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:39.053114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27194d1d-33f9-4ad3-a691-9456b436f104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6989cbd135d744de861fa22cace1177a, group_id=3bff9f4b0d4444ad80a377104104cb63, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:39.080212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27194d1d-33f9-4ad3-a691-9456b436f104 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:39.166817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 127/252] 10.222.0.87 () {58 vars in 1463 bytes} [Tue Jan 18 12:38:39 2022] PUT /identity/v3/projects/6989cbd135d744de861fa22cace1177a/groups/3bff9f4b0d4444ad80a377104104cb63/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:38:41.182540 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12772c46-7c6d-46bf-9a0f-b1889cdaead6 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:41.183465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12772c46-7c6d-46bf-9a0f-b1889cdaead6 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:41.183754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12772c46-7c6d-46bf-9a0f-b1889cdaead6 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:41.187185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 126/253] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:41.192378 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154c387-b13b-43e2-8f1f-662a8333a4ee None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:41.192779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154c387-b13b-43e2-8f1f-662a8333a4ee None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:41.192964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154c387-b13b-43e2-8f1f-662a8333a4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:41.215710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-2154c387-b13b-43e2-8f1f-662a8333a4ee None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:41.216872 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2154c387-b13b-43e2-8f1f-662a8333a4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:41.281867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 128/254] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:41 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:41.304790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12772c46-7c6d-46bf-9a0f-b1889cdaead6 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:41.317321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12772c46-7c6d-46bf-9a0f-b1889cdaead6 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:41.321179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3df022-2a2d-4558-82be-d374ee218f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:41.321893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3df022-2a2d-4558-82be-d374ee218f39 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:41.322180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3df022-2a2d-4558-82be-d374ee218f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:41.322465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3df022-2a2d-4558-82be-d374ee218f39 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:41.334743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3df022-2a2d-4558-82be-d374ee218f39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:41.341322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-3b3df022-2a2d-4558-82be-d374ee218f39 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:41.342986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 127/255] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:41.349028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154c387-b13b-43e2-8f1f-662a8333a4ee None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:41.358579 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154c387-b13b-43e2-8f1f-662a8333a4ee None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:41.362529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b17db-7152-4dba-9461-249d4ccbbaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:41.363115 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b17db-7152-4dba-9461-249d4ccbbaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:41.363438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b17db-7152-4dba-9461-249d4ccbbaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:41.363739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b17db-7152-4dba-9461-249d4ccbbaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:41.364421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b17db-7152-4dba-9461-249d4ccbbaa5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:41.364718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b17db-7152-4dba-9461-249d4ccbbaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:41.391086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b17db-7152-4dba-9461-249d4ccbbaa5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:41.399817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 129/256] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:41.405871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3df022-2a2d-4558-82be-d374ee218f39 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:41.415466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3df022-2a2d-4558-82be-d374ee218f39 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:41.419275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1dda-fbd1-48b5-ace6-9f2f9b9190ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:41.419875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1dda-fbd1-48b5-ace6-9f2f9b9190ab admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:41.421060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1dda-fbd1-48b5-ace6-9f2f9b9190ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:41.421060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba1dda-fbd1-48b5-ace6-9f2f9b9190ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:41.428644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1dda-fbd1-48b5-ace6-9f2f9b9190ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:41.454791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba1dda-fbd1-48b5-ace6-9f2f9b9190ab admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:41.469087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 128/257] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:41 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:41.474660 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b17db-7152-4dba-9461-249d4ccbbaa5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:41.484968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b17db-7152-4dba-9461-249d4ccbbaa5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:41.488917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf8e7e-5d05-4e7a-a49f-645dc4ff6413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:41.489694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf8e7e-5d05-4e7a-a49f-645dc4ff6413 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:41.489980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf8e7e-5d05-4e7a-a49f-645dc4ff6413 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:41.490260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf8e7e-5d05-4e7a-a49f-645dc4ff6413 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:41.491402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf8e7e-5d05-4e7a-a49f-645dc4ff6413 admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:41.518003 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf8e7e-5d05-4e7a-a49f-645dc4ff6413 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:41.519683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 130/258] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:41 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:41.525355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1dda-fbd1-48b5-ace6-9f2f9b9190ab admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:41.534126 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba1dda-fbd1-48b5-ace6-9f2f9b9190ab admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:41.538530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6e6c7-bd00-4da9-8270-9eb15b1db7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:41.539392 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e6c7-bd00-4da9-8270-9eb15b1db7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:41.539619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e6c7-bd00-4da9-8270-9eb15b1db7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:41.539898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e6c7-bd00-4da9-8270-9eb15b1db7f1 admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:41.540991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6e6c7-bd00-4da9-8270-9eb15b1db7f1 admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:41.566942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-b3f6e6c7-bd00-4da9-8270-9eb15b1db7f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:38:41.566942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:38:41.566942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:38:41.568126 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6e6c7-bd00-4da9-8270-9eb15b1db7f1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:41.569594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 129/259] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:41 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:41.575270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf8e7e-5d05-4e7a-a49f-645dc4ff6413 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:41.584654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf8e7e-5d05-4e7a-a49f-645dc4ff6413 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:41.588577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a009f-dd3d-48af-85f8-db2cbd912885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:41.589147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a009f-dd3d-48af-85f8-db2cbd912885 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:41.589440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a009f-dd3d-48af-85f8-db2cbd912885 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:41.589726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a009f-dd3d-48af-85f8-db2cbd912885 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:41.590500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a009f-dd3d-48af-85f8-db2cbd912885 admin admin] RBAC: Adding query filter params (group.id=3bff9f4b0d4444ad80a377104104cb63, role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=6989cbd135d744de861fa22cace1177a) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:41.590803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a009f-dd3d-48af-85f8-db2cbd912885 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:41.617843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a009f-dd3d-48af-85f8-db2cbd912885 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:41.623790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 131/260] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:38:41 2022] GET /identity/v3/role_assignments?group.id=3bff9f4b0d4444ad80a377104104cb63&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 611 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:43.627605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6416bf-f7df-464c-9134-c9e506f709ab None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:43.628156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6416bf-f7df-464c-9134-c9e506f709ab None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:43.628156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6416bf-f7df-464c-9134-c9e506f709ab None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:43.629828 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 130/261] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:43.634829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc73a-3f90-4b89-9a0e-e12557c5adec None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:43.635203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc73a-3f90-4b89-9a0e-e12557c5adec None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:43.635420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc73a-3f90-4b89-9a0e-e12557c5adec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:43.658056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a8efc73a-3f90-4b89-9a0e-e12557c5adec None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:43.659177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a8efc73a-3f90-4b89-9a0e-e12557c5adec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:43.666203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 132/262] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:43 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:43.689332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6416bf-f7df-464c-9134-c9e506f709ab None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:43.700805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6416bf-f7df-464c-9134-c9e506f709ab None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:43.704820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155ab09-fa4a-4f88-a5f6-cec9b24e0190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:43.705542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ab09-fa4a-4f88-a5f6-cec9b24e0190 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:43.705830 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ab09-fa4a-4f88-a5f6-cec9b24e0190 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:43.706113 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155ab09-fa4a-4f88-a5f6-cec9b24e0190 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:43.717165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b155ab09-fa4a-4f88-a5f6-cec9b24e0190 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:43.723748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b155ab09-fa4a-4f88-a5f6-cec9b24e0190 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:38:43.724808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 131/263] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:38:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:38:43.730326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc73a-3f90-4b89-9a0e-e12557c5adec None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:43.739436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc73a-3f90-4b89-9a0e-e12557c5adec None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:43.743508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93748bae-8039-4aae-a904-ba9336d03707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:43.744093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748bae-8039-4aae-a904-ba9336d03707 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:43.744381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748bae-8039-4aae-a904-ba9336d03707 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:43.744660 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93748bae-8039-4aae-a904-ba9336d03707 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:43.745353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93748bae-8039-4aae-a904-ba9336d03707 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:43.745651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93748bae-8039-4aae-a904-ba9336d03707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:43.772167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93748bae-8039-4aae-a904-ba9336d03707 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:43.781436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 133/264] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:38:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:43.787121 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155ab09-fa4a-4f88-a5f6-cec9b24e0190 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:43.801884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155ab09-fa4a-4f88-a5f6-cec9b24e0190 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:43.806662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592ed81-c92f-41f0-b028-d09c9851897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:43.807242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592ed81-c92f-41f0-b028-d09c9851897b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:43.807563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592ed81-c92f-41f0-b028-d09c9851897b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:43.807847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592ed81-c92f-41f0-b028-d09c9851897b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:43.816634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592ed81-c92f-41f0-b028-d09c9851897b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:43.842995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592ed81-c92f-41f0-b028-d09c9851897b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:43.851840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 132/265] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:43 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 12:38:43.857409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93748bae-8039-4aae-a904-ba9336d03707 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:43.866702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93748bae-8039-4aae-a904-ba9336d03707 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:43.870715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c68db-3633-442c-b924-99eae3bf2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:43.871524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c68db-3633-442c-b924-99eae3bf2bde admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:43.871811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c68db-3633-442c-b924-99eae3bf2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:43.872088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c68db-3633-442c-b924-99eae3bf2bde admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:43.873677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c68db-3633-442c-b924-99eae3bf2bde admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:43.900170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c68db-3633-442c-b924-99eae3bf2bde admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:43.901627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 134/266] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:43 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:43.907386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592ed81-c92f-41f0-b028-d09c9851897b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:43.918840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592ed81-c92f-41f0-b028-d09c9851897b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:43.924112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9038fd-8d1e-4111-9fc8-237fd6ea97f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:43.924893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9038fd-8d1e-4111-9fc8-237fd6ea97f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:43.925221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9038fd-8d1e-4111-9fc8-237fd6ea97f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:43.925510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9038fd-8d1e-4111-9fc8-237fd6ea97f8 admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:43.926635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9038fd-8d1e-4111-9fc8-237fd6ea97f8 admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:43.956886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9038fd-8d1e-4111-9fc8-237fd6ea97f8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:43.958392 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 133/267] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:43 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:43.964072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c68db-3633-442c-b924-99eae3bf2bde admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:43.973563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c68db-3633-442c-b924-99eae3bf2bde admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:43.977510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812aa2b-c1c9-47ea-8461-fbf640d190ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:43.978081 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812aa2b-c1c9-47ea-8461-fbf640d190ec admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:43.978371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812aa2b-c1c9-47ea-8461-fbf640d190ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:43.978652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812aa2b-c1c9-47ea-8461-fbf640d190ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:43.979460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812aa2b-c1c9-47ea-8461-fbf640d190ec admin admin] RBAC: Adding query filter params (group.id=3bff9f4b0d4444ad80a377104104cb63, role.id=3876294260db4719972a530e23d90b2f, scope.project.id=6989cbd135d744de861fa22cace1177a) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:43.979765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812aa2b-c1c9-47ea-8461-fbf640d190ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:44.005777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812aa2b-c1c9-47ea-8461-fbf640d190ec admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:44.011685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 135/268] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:38:43 2022] GET /identity/v3/role_assignments?group.id=3bff9f4b0d4444ad80a377104104cb63&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=3876294260db4719972a530e23d90b2f => generated 260 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:45.963974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff554e6-960d-4f4c-b3dd-e06b7c3e9ec4 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:45.964495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff554e6-960d-4f4c-b3dd-e06b7c3e9ec4 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:45.964581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff554e6-960d-4f4c-b3dd-e06b7c3e9ec4 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:45.966219 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 134/269] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:45.971993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cc671-19a0-4920-bcbe-ae79dcea9280 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:45.972474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cc671-19a0-4920-bcbe-ae79dcea9280 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:45.972563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5cc671-19a0-4920-bcbe-ae79dcea9280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:45.995239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7a5cc671-19a0-4920-bcbe-ae79dcea9280 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:45.996413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7a5cc671-19a0-4920-bcbe-ae79dcea9280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:46.003706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 136/270] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:45 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:46.025034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff554e6-960d-4f4c-b3dd-e06b7c3e9ec4 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:46.037734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff554e6-960d-4f4c-b3dd-e06b7c3e9ec4 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:46.041588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ded7d-9b13-4582-ba82-e3a0bbf9a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:46.042317 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ded7d-9b13-4582-ba82-e3a0bbf9a480 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:46.042607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ded7d-9b13-4582-ba82-e3a0bbf9a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:46.042892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ded7d-9b13-4582-ba82-e3a0bbf9a480 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:46.054855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ded7d-9b13-4582-ba82-e3a0bbf9a480 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:46.062407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-887ded7d-9b13-4582-ba82-e3a0bbf9a480 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:38:46.063571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 135/271] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:38:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:46.069337 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cc671-19a0-4920-bcbe-ae79dcea9280 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:46.078944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5cc671-19a0-4920-bcbe-ae79dcea9280 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:46.083107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e475b6-8e52-4080-bb8d-2bd72bec6a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:46.083801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e475b6-8e52-4080-bb8d-2bd72bec6a82 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:46.084158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e475b6-8e52-4080-bb8d-2bd72bec6a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:46.084599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e475b6-8e52-4080-bb8d-2bd72bec6a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:46.085395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e475b6-8e52-4080-bb8d-2bd72bec6a82 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:46.085760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e475b6-8e52-4080-bb8d-2bd72bec6a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:46.111902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e475b6-8e52-4080-bb8d-2bd72bec6a82 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:46.120592 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 137/272] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:38:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:46.126645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ded7d-9b13-4582-ba82-e3a0bbf9a480 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:46.136897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ded7d-9b13-4582-ba82-e3a0bbf9a480 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:46.141775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdc5e7-41a6-4b84-91b6-60b6476256ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:46.142571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc5e7-41a6-4b84-91b6-60b6476256ae admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:46.142825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc5e7-41a6-4b84-91b6-60b6476256ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:46.143102 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdc5e7-41a6-4b84-91b6-60b6476256ae admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:46.144179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdc5e7-41a6-4b84-91b6-60b6476256ae admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:46.169978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdc5e7-41a6-4b84-91b6-60b6476256ae admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:46.171597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 136/273] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:46 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:46.176842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e475b6-8e52-4080-bb8d-2bd72bec6a82 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:46.186715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e475b6-8e52-4080-bb8d-2bd72bec6a82 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:46.190960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f48861-79d4-4476-a78f-4783818bc748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:46.191766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f48861-79d4-4476-a78f-4783818bc748 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:46.192078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f48861-79d4-4476-a78f-4783818bc748 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:46.192428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f48861-79d4-4476-a78f-4783818bc748 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:46.193558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f48861-79d4-4476-a78f-4783818bc748 admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:46.220282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f48861-79d4-4476-a78f-4783818bc748 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:46.221792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 138/274] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:46 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:46.227332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdc5e7-41a6-4b84-91b6-60b6476256ae admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:46.237140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdc5e7-41a6-4b84-91b6-60b6476256ae admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:46.241052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67186a-eb0d-4d47-b163-9e7a84a9b268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:46.241854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67186a-eb0d-4d47-b163-9e7a84a9b268 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:46.242148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67186a-eb0d-4d47-b163-9e7a84a9b268 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:46.242427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67186a-eb0d-4d47-b163-9e7a84a9b268 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a/groups/3bff9f4b0d4444ad80a377104104cb63/roles/3876294260db4719972a530e23d90b2f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:46.244398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67186a-eb0d-4d47-b163-9e7a84a9b268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6989cbd135d744de861fa22cace1177a, group_id=3bff9f4b0d4444ad80a377104104cb63, role_id=3876294260db4719972a530e23d90b2f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:46.272488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67186a-eb0d-4d47-b163-9e7a84a9b268 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:46.410286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 137/275] 10.222.0.87 () {58 vars in 1463 bytes} [Tue Jan 18 12:38:46 2022] PUT /identity/v3/projects/6989cbd135d744de861fa22cace1177a/groups/3bff9f4b0d4444ad80a377104104cb63/roles/3876294260db4719972a530e23d90b2f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 12:38:48.399414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83c38e-cfc1-48b4-b05d-c67eeb7ce087 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:48.399920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83c38e-cfc1-48b4-b05d-c67eeb7ce087 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:48.399920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83c38e-cfc1-48b4-b05d-c67eeb7ce087 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:48.401560 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 139/276] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:48.407562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b6041-87e0-4c85-9ecc-6ce21b751711 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:48.407959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b6041-87e0-4c85-9ecc-6ce21b751711 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:48.408125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b6041-87e0-4c85-9ecc-6ce21b751711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:48.431975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-278b6041-87e0-4c85-9ecc-6ce21b751711 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:48.433086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-278b6041-87e0-4c85-9ecc-6ce21b751711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:48.499144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 138/277] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:48 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:38:48.526002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83c38e-cfc1-48b4-b05d-c67eeb7ce087 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:48.541402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83c38e-cfc1-48b4-b05d-c67eeb7ce087 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:48.547609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31f452-65ca-409c-8e3a-2a64cc58a256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:48.548793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f452-65ca-409c-8e3a-2a64cc58a256 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:48.549218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f452-65ca-409c-8e3a-2a64cc58a256 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:48.549626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f452-65ca-409c-8e3a-2a64cc58a256 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:48.563368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31f452-65ca-409c-8e3a-2a64cc58a256 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:48.569959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-da31f452-65ca-409c-8e3a-2a64cc58a256 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:38:48.571047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 140/278] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:38:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:38:48.577171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b6041-87e0-4c85-9ecc-6ce21b751711 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:48.585873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b6041-87e0-4c85-9ecc-6ce21b751711 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:48.589884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1d9bc-cb6b-4c33-bceb-6e5a505017bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:48.590473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1d9bc-cb6b-4c33-bceb-6e5a505017bc admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:48.590757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1d9bc-cb6b-4c33-bceb-6e5a505017bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:48.591037 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1d9bc-cb6b-4c33-bceb-6e5a505017bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:48.592503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1d9bc-cb6b-4c33-bceb-6e5a505017bc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:48.592816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1d9bc-cb6b-4c33-bceb-6e5a505017bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:48.618744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1d9bc-cb6b-4c33-bceb-6e5a505017bc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:48.627282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 139/279] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:38:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:48.632867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31f452-65ca-409c-8e3a-2a64cc58a256 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:48.641958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31f452-65ca-409c-8e3a-2a64cc58a256 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:48.645841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b38412-05e2-4b66-8c2f-4c2041e40722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:48.646398 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b38412-05e2-4b66-8c2f-4c2041e40722 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:48.646683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b38412-05e2-4b66-8c2f-4c2041e40722 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:48.646959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b38412-05e2-4b66-8c2f-4c2041e40722 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:48.655035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b38412-05e2-4b66-8c2f-4c2041e40722 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:48.681165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b38412-05e2-4b66-8c2f-4c2041e40722 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:48.689667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 141/280] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:48 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:48.695241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1d9bc-cb6b-4c33-bceb-6e5a505017bc admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:48.705349 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1d9bc-cb6b-4c33-bceb-6e5a505017bc admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:48.709277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed004-5bab-4fd8-aeed-de3e0d58253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:48.710054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed004-5bab-4fd8-aeed-de3e0d58253c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:48.710342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed004-5bab-4fd8-aeed-de3e0d58253c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:48.710624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed004-5bab-4fd8-aeed-de3e0d58253c admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:48.711719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed004-5bab-4fd8-aeed-de3e0d58253c admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:48.737993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed004-5bab-4fd8-aeed-de3e0d58253c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:48.739526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 140/281] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:48 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:48.744948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b38412-05e2-4b66-8c2f-4c2041e40722 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:48.753547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b38412-05e2-4b66-8c2f-4c2041e40722 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:48.757526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce860b8-50ff-4449-905a-8347b79028b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:48.758300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce860b8-50ff-4449-905a-8347b79028b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:48.758588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce860b8-50ff-4449-905a-8347b79028b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:48.758923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce860b8-50ff-4449-905a-8347b79028b5 admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:48.759941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce860b8-50ff-4449-905a-8347b79028b5 admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:48.786669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce860b8-50ff-4449-905a-8347b79028b5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:48.788146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 142/282] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:48 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:48.793467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed004-5bab-4fd8-aeed-de3e0d58253c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:48.802740 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed004-5bab-4fd8-aeed-de3e0d58253c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:48.806648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88c581-681a-4766-9022-95f5da00a47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:48.807220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c581-681a-4766-9022-95f5da00a47b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:48.807528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c581-681a-4766-9022-95f5da00a47b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:48.807808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88c581-681a-4766-9022-95f5da00a47b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:48.808587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88c581-681a-4766-9022-95f5da00a47b admin admin] RBAC: Adding query filter params (group.id=3bff9f4b0d4444ad80a377104104cb63, role.id=3876294260db4719972a530e23d90b2f, scope.project.id=6989cbd135d744de861fa22cace1177a) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:48.808884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88c581-681a-4766-9022-95f5da00a47b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:48.836364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a88c581-681a-4766-9022-95f5da00a47b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:48.844430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 141/283] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:38:48 2022] GET /identity/v3/role_assignments?group.id=3bff9f4b0d4444ad80a377104104cb63&scope.project.id=6989cbd135d744de861fa22cace1177a&role.id=3876294260db4719972a530e23d90b2f => generated 611 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:50.814037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb743c1-e9f7-403c-a87d-e7226dcb7280 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:50.814563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb743c1-e9f7-403c-a87d-e7226dcb7280 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:50.814677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb743c1-e9f7-403c-a87d-e7226dcb7280 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:50.816360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 143/284] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:50.821515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95ca7e-666f-431b-8563-c4c46acafc1f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:50.821907 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95ca7e-666f-431b-8563-c4c46acafc1f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:50.822090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b95ca7e-666f-431b-8563-c4c46acafc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:50.846293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4b95ca7e-666f-431b-8563-c4c46acafc1f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:50.847463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4b95ca7e-666f-431b-8563-c4c46acafc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:50.854105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 142/285] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:50 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:50.877359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb743c1-e9f7-403c-a87d-e7226dcb7280 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:50.888987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb743c1-e9f7-403c-a87d-e7226dcb7280 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:50.892819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b624c0-c6d2-4ce8-9231-3641cc5bc880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:50.893525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b624c0-c6d2-4ce8-9231-3641cc5bc880 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:50.893809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b624c0-c6d2-4ce8-9231-3641cc5bc880 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:50.894086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b624c0-c6d2-4ce8-9231-3641cc5bc880 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:50.905640 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b624c0-c6d2-4ce8-9231-3641cc5bc880 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:50.912125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-f4b624c0-c6d2-4ce8-9231-3641cc5bc880 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:50.913201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 144/286] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:50.919048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95ca7e-666f-431b-8563-c4c46acafc1f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:50.928319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b95ca7e-666f-431b-8563-c4c46acafc1f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:50.932268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759967a4-e14b-47b1-8c5a-d99bfb52c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:50.932858 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759967a4-e14b-47b1-8c5a-d99bfb52c7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:50.933144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759967a4-e14b-47b1-8c5a-d99bfb52c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:50.933513 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759967a4-e14b-47b1-8c5a-d99bfb52c7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:50.934227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759967a4-e14b-47b1-8c5a-d99bfb52c7c0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:50.934526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759967a4-e14b-47b1-8c5a-d99bfb52c7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:50.960732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759967a4-e14b-47b1-8c5a-d99bfb52c7c0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:50.970270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 143/287] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:50.976119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b624c0-c6d2-4ce8-9231-3641cc5bc880 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:50.986333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b624c0-c6d2-4ce8-9231-3641cc5bc880 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:50.990235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d0642-dcf8-4a20-a72c-696b796a2367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:50.990803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d0642-dcf8-4a20-a72c-696b796a2367 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:50.991083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d0642-dcf8-4a20-a72c-696b796a2367 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:50.991399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d0642-dcf8-4a20-a72c-696b796a2367 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:50.998835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d0642-dcf8-4a20-a72c-696b796a2367 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:51.024463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d0642-dcf8-4a20-a72c-696b796a2367 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:51.033276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 145/288] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:50 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:51.038994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759967a4-e14b-47b1-8c5a-d99bfb52c7c0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:51.048222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759967a4-e14b-47b1-8c5a-d99bfb52c7c0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:51.052120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631c84f-ae4a-4dd8-9129-cc98272b73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:51.052892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c84f-ae4a-4dd8-9129-cc98272b73c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:51.053181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c84f-ae4a-4dd8-9129-cc98272b73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:51.053463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c84f-ae4a-4dd8-9129-cc98272b73c7 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:51.054622 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631c84f-ae4a-4dd8-9129-cc98272b73c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:51.080886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631c84f-ae4a-4dd8-9129-cc98272b73c7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:51.082413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 144/289] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:51 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:51.087921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d0642-dcf8-4a20-a72c-696b796a2367 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:51.097421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d0642-dcf8-4a20-a72c-696b796a2367 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:51.101571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b460cb-7f06-4e99-827a-8c6cbfbecc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:51.102456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b460cb-7f06-4e99-827a-8c6cbfbecc75 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:51.102751 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b460cb-7f06-4e99-827a-8c6cbfbecc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:51.103033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b460cb-7f06-4e99-827a-8c6cbfbecc75 admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:51.104128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b460cb-7f06-4e99-827a-8c6cbfbecc75 admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:51.129668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b460cb-7f06-4e99-827a-8c6cbfbecc75 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:51.131119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 146/290] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:51 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:51.136825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631c84f-ae4a-4dd8-9129-cc98272b73c7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:51.146682 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631c84f-ae4a-4dd8-9129-cc98272b73c7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:51.150538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e08c-4122-4d4f-aa84-bbf9baa356d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:51.151105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e08c-4122-4d4f-aa84-bbf9baa356d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:51.151454 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e08c-4122-4d4f-aa84-bbf9baa356d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:51.151739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e08c-4122-4d4f-aa84-bbf9baa356d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:51.152515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e08c-4122-4d4f-aa84-bbf9baa356d1 admin admin] RBAC: Adding query filter params (group.id=3bff9f4b0d4444ad80a377104104cb63, role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:51.152818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e08c-4122-4d4f-aa84-bbf9baa356d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:51.179707 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e08c-4122-4d4f-aa84-bbf9baa356d1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:51.185811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 145/291] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:38:51 2022] GET /identity/v3/role_assignments?group.id=3bff9f4b0d4444ad80a377104104cb63&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:53.340492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35cd5d-1d1d-4c9f-8946-0ae2d3908cb8 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:53.341070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35cd5d-1d1d-4c9f-8946-0ae2d3908cb8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:53.341070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35cd5d-1d1d-4c9f-8946-0ae2d3908cb8 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:53.343752 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 147/292] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:53.348993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca68893-49ea-4e9a-a660-755dd5d483a8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:53.349443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca68893-49ea-4e9a-a660-755dd5d483a8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:53.349567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca68893-49ea-4e9a-a660-755dd5d483a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:53.371886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-dca68893-49ea-4e9a-a660-755dd5d483a8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:53.373451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dca68893-49ea-4e9a-a660-755dd5d483a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:53.380111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 146/293] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:53 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:53.401988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35cd5d-1d1d-4c9f-8946-0ae2d3908cb8 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:53.414321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35cd5d-1d1d-4c9f-8946-0ae2d3908cb8 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:53.418151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36929194-4d0d-4fa8-b8bf-ab9195db0766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:53.418850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929194-4d0d-4fa8-b8bf-ab9195db0766 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:53.419134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929194-4d0d-4fa8-b8bf-ab9195db0766 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:53.419440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929194-4d0d-4fa8-b8bf-ab9195db0766 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:53.430286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36929194-4d0d-4fa8-b8bf-ab9195db0766 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:53.436720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-36929194-4d0d-4fa8-b8bf-ab9195db0766 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:53.437789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 148/294] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:53.443354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca68893-49ea-4e9a-a660-755dd5d483a8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:53.453007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca68893-49ea-4e9a-a660-755dd5d483a8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:53.457011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bed3f3-69ab-4c79-807d-0d32fd4933ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:53.457609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bed3f3-69ab-4c79-807d-0d32fd4933ef admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:53.457898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bed3f3-69ab-4c79-807d-0d32fd4933ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:53.458180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bed3f3-69ab-4c79-807d-0d32fd4933ef admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:53.458893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bed3f3-69ab-4c79-807d-0d32fd4933ef admin admin] RBAC: Adding query filter params (name=member) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:53.459193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bed3f3-69ab-4c79-807d-0d32fd4933ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:53.485863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bed3f3-69ab-4c79-807d-0d32fd4933ef admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:53.494679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 147/295] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:53.500228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36929194-4d0d-4fa8-b8bf-ab9195db0766 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:53.510534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36929194-4d0d-4fa8-b8bf-ab9195db0766 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:53.515577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8d88-1a69-48d4-9085-3d8821b5da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:53.516345 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8d88-1a69-48d4-9085-3d8821b5da30 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:53.516633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8d88-1a69-48d4-9085-3d8821b5da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:53.516912 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8d88-1a69-48d4-9085-3d8821b5da30 admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:53.517997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b8d88-1a69-48d4-9085-3d8821b5da30 admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:53.545267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b8d88-1a69-48d4-9085-3d8821b5da30 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:53.546821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 149/296] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:53 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:53.552352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bed3f3-69ab-4c79-807d-0d32fd4933ef admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:53.562646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bed3f3-69ab-4c79-807d-0d32fd4933ef admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:53.566582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab8303-01f5-4a74-998d-f00930dacc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:53.567397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab8303-01f5-4a74-998d-f00930dacc9e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:53.567697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab8303-01f5-4a74-998d-f00930dacc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:53.567982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab8303-01f5-4a74-998d-f00930dacc9e admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:53.569051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab8303-01f5-4a74-998d-f00930dacc9e admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:53.596443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab8303-01f5-4a74-998d-f00930dacc9e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:53.597919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 148/297] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:53 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:38:53.603214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8d88-1a69-48d4-9085-3d8821b5da30 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:53.612737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8d88-1a69-48d4-9085-3d8821b5da30 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:53.616718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b30e2-05fa-4606-90b6-445c8257539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:53.617510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b30e2-05fa-4606-90b6-445c8257539e admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:53.617803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b30e2-05fa-4606-90b6-445c8257539e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:53.618089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b30e2-05fa-4606-90b6-445c8257539e admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/groups/3bff9f4b0d4444ad80a377104104cb63/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:53.619865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b30e2-05fa-4606-90b6-445c8257539e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d, group_id=3bff9f4b0d4444ad80a377104104cb63, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:53.647036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b30e2-05fa-4606-90b6-445c8257539e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:53.760063 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 150/298] 10.222.0.87 () {58 vars in 1463 bytes} [Tue Jan 18 12:38:53 2022] PUT /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/groups/3bff9f4b0d4444ad80a377104104cb63/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:38:55.728417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0a169-935d-4c27-a9c6-c9a625b46500 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:55.728965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0a169-935d-4c27-a9c6-c9a625b46500 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:55.728965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0a169-935d-4c27-a9c6-c9a625b46500 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:55.730647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 149/299] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:55.735712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902218f6-d1c3-4ac4-980c-88214dbd443e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:55.736118 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902218f6-d1c3-4ac4-980c-88214dbd443e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:55.736284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902218f6-d1c3-4ac4-980c-88214dbd443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:55.758309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-902218f6-d1c3-4ac4-980c-88214dbd443e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:55.759489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-902218f6-d1c3-4ac4-980c-88214dbd443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:55.824297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 151/300] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:55 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:55.848374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0a169-935d-4c27-a9c6-c9a625b46500 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:55.861225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0a169-935d-4c27-a9c6-c9a625b46500 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:55.865090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262172-abd1-4bef-9ca1-eab47ee562be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:55.865811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262172-abd1-4bef-9ca1-eab47ee562be admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:55.866102 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262172-abd1-4bef-9ca1-eab47ee562be admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:55.866383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37262172-abd1-4bef-9ca1-eab47ee562be admin admin] PATH_INFO: `/v3/roles/member` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:55.878685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37262172-abd1-4bef-9ca1-eab47ee562be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:55.885059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-37262172-abd1-4bef-9ca1-eab47ee562be admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 18 12:38:55.886151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 150/301] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:55.892194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902218f6-d1c3-4ac4-980c-88214dbd443e None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:55.900755 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902218f6-d1c3-4ac4-980c-88214dbd443e None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:55.905251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff805e3f-d877-483d-8ba7-96eeb0d1ae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:55.905927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff805e3f-d877-483d-8ba7-96eeb0d1ae7e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:55.906221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff805e3f-d877-483d-8ba7-96eeb0d1ae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:55.906505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff805e3f-d877-483d-8ba7-96eeb0d1ae7e admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:55.907206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff805e3f-d877-483d-8ba7-96eeb0d1ae7e admin admin] RBAC: Adding query filter params (name=member) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:55.907570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff805e3f-d877-483d-8ba7-96eeb0d1ae7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:55.933775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff805e3f-d877-483d-8ba7-96eeb0d1ae7e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:55.942643 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 152/302] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:55.948404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262172-abd1-4bef-9ca1-eab47ee562be admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:55.958047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37262172-abd1-4bef-9ca1-eab47ee562be admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:55.962025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b944-fcf0-43d4-8070-530ee737528b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:55.962597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b944-fcf0-43d4-8070-530ee737528b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:55.962887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b944-fcf0-43d4-8070-530ee737528b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:55.963174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b944-fcf0-43d4-8070-530ee737528b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:55.971742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b944-fcf0-43d4-8070-530ee737528b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:55.998059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b944-fcf0-43d4-8070-530ee737528b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:56.006966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 151/303] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:55 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:56.012282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff805e3f-d877-483d-8ba7-96eeb0d1ae7e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:56.021686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff805e3f-d877-483d-8ba7-96eeb0d1ae7e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:56.025678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2196f-d401-45b0-bbb4-a83e6c8c5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:56.026462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2196f-d401-45b0-bbb4-a83e6c8c5cfe admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:56.026751 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2196f-d401-45b0-bbb4-a83e6c8c5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:56.027035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2196f-d401-45b0-bbb4-a83e6c8c5cfe admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:56.028157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2196f-d401-45b0-bbb4-a83e6c8c5cfe admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:56.055937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2196f-d401-45b0-bbb4-a83e6c8c5cfe admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:56.057559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 153/304] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:56 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:56.063106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b944-fcf0-43d4-8070-530ee737528b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:56.071821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b944-fcf0-43d4-8070-530ee737528b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:56.075751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235635d-e7da-4467-bfd9-f7e2d4210d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:56.076577 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235635d-e7da-4467-bfd9-f7e2d4210d05 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:56.077014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235635d-e7da-4467-bfd9-f7e2d4210d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:56.077305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235635d-e7da-4467-bfd9-f7e2d4210d05 admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:56.078415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235635d-e7da-4467-bfd9-f7e2d4210d05 admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:56.105105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235635d-e7da-4467-bfd9-f7e2d4210d05 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:56.106716 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 152/305] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:56 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:56.113384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2196f-d401-45b0-bbb4-a83e6c8c5cfe admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:56.122745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2196f-d401-45b0-bbb4-a83e6c8c5cfe admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:56.126556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ac5f0-d120-4fcf-b6d1-5a9fc521af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:56.127143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ac5f0-d120-4fcf-b6d1-5a9fc521af9d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:56.127469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ac5f0-d120-4fcf-b6d1-5a9fc521af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:56.127752 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ac5f0-d120-4fcf-b6d1-5a9fc521af9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:56.128514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ac5f0-d120-4fcf-b6d1-5a9fc521af9d admin admin] RBAC: Adding query filter params (group.id=3bff9f4b0d4444ad80a377104104cb63, role.id=8446160cb99a4e83afec03d9b67986b6, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:56.128814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ac5f0-d120-4fcf-b6d1-5a9fc521af9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:56.154929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ac5f0-d120-4fcf-b6d1-5a9fc521af9d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:56.161045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 154/306] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:38:56 2022] GET /identity/v3/role_assignments?group.id=3bff9f4b0d4444ad80a377104104cb63&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=8446160cb99a4e83afec03d9b67986b6 => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:58.151141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361600f-3292-4ff1-9016-58862088dbfc None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:58.151704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361600f-3292-4ff1-9016-58862088dbfc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:58.151798 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361600f-3292-4ff1-9016-58862088dbfc None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:58.153459 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 153/307] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:38:58.158603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7c857-52be-4b9f-abf7-5114fbbdb286 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:58.159027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7c857-52be-4b9f-abf7-5114fbbdb286 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:58.159172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7c857-52be-4b9f-abf7-5114fbbdb286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:58.182000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a8f7c857-52be-4b9f-abf7-5114fbbdb286 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:38:58.183127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a8f7c857-52be-4b9f-abf7-5114fbbdb286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:38:58.190813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 155/308] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:38:58 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:38:58.214315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361600f-3292-4ff1-9016-58862088dbfc None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:58.226029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361600f-3292-4ff1-9016-58862088dbfc None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:58.229779 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f1917-9591-415f-a54d-17a5b2b3944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:58.230493 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f1917-9591-415f-a54d-17a5b2b3944b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:58.230773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f1917-9591-415f-a54d-17a5b2b3944b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:58.231047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f1917-9591-415f-a54d-17a5b2b3944b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:58.241890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9f1917-9591-415f-a54d-17a5b2b3944b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:38:58.248977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-9a9f1917-9591-415f-a54d-17a5b2b3944b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:38:58.250025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 154/309] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:38:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:38:58.255407 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7c857-52be-4b9f-abf7-5114fbbdb286 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:58.265525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7c857-52be-4b9f-abf7-5114fbbdb286 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:58.269495 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc587-b897-452e-9384-8bdb6f13e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:58.270082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc587-b897-452e-9384-8bdb6f13e076 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:58.270372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc587-b897-452e-9384-8bdb6f13e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:58.270650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cc587-b897-452e-9384-8bdb6f13e076 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:58.271413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cc587-b897-452e-9384-8bdb6f13e076 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:58.271679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cc587-b897-452e-9384-8bdb6f13e076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:58.297637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44cc587-b897-452e-9384-8bdb6f13e076 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:58.306169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 156/310] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:38:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:58.312651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f1917-9591-415f-a54d-17a5b2b3944b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:58.322795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9f1917-9591-415f-a54d-17a5b2b3944b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:58.327359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca21a0-bc03-432a-90f6-11a7c589d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:58.327920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca21a0-bc03-432a-90f6-11a7c589d789 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:58.328207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca21a0-bc03-432a-90f6-11a7c589d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:58.328481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca21a0-bc03-432a-90f6-11a7c589d789 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:58.335963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca21a0-bc03-432a-90f6-11a7c589d789 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:58.361325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca21a0-bc03-432a-90f6-11a7c589d789 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:58.369581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 155/311] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:38:58 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:38:58.375906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc587-b897-452e-9384-8bdb6f13e076 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:58.385184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cc587-b897-452e-9384-8bdb6f13e076 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:58.390204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f11456-5a9a-49ae-a554-3d655bfd1143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:58.390982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f11456-5a9a-49ae-a554-3d655bfd1143 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:58.391273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f11456-5a9a-49ae-a554-3d655bfd1143 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:58.391592 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f11456-5a9a-49ae-a554-3d655bfd1143 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:58.392687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f11456-5a9a-49ae-a554-3d655bfd1143 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:58.418973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f11456-5a9a-49ae-a554-3d655bfd1143 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:58.421468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 157/312] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:38:58 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:58.427007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca21a0-bc03-432a-90f6-11a7c589d789 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:58.436409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca21a0-bc03-432a-90f6-11a7c589d789 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:58.440339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868f7b5-4594-4979-aa0e-e5c460b91168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:58.441114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868f7b5-4594-4979-aa0e-e5c460b91168 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:58.441427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868f7b5-4594-4979-aa0e-e5c460b91168 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:58.441705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868f7b5-4594-4979-aa0e-e5c460b91168 admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:58.442747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868f7b5-4594-4979-aa0e-e5c460b91168 admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:58.468975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868f7b5-4594-4979-aa0e-e5c460b91168 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:58.470510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 156/313] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:38:58 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:38:58.475960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f11456-5a9a-49ae-a554-3d655bfd1143 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:38:58.485795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f11456-5a9a-49ae-a554-3d655bfd1143 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:38:58.489697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd3bad-f782-443d-8ab3-833c7f295b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:38:58.490265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd3bad-f782-443d-8ab3-833c7f295b40 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:38:58.490557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd3bad-f782-443d-8ab3-833c7f295b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:38:58.490842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd3bad-f782-443d-8ab3-833c7f295b40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:38:58.491638 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd3bad-f782-443d-8ab3-833c7f295b40 admin admin] RBAC: Adding query filter params (group.id=3bff9f4b0d4444ad80a377104104cb63, role.id=3876294260db4719972a530e23d90b2f, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:38:58.491941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd3bad-f782-443d-8ab3-833c7f295b40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:38:58.518263 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd3bad-f782-443d-8ab3-833c7f295b40 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:38:58.524209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 158/314] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:38:58 2022] GET /identity/v3/role_assignments?group.id=3bff9f4b0d4444ad80a377104104cb63&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=3876294260db4719972a530e23d90b2f => generated 260 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:00.451597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e16b79-4572-4bef-bff4-7442fbabcbe1 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:00.452117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e16b79-4572-4bef-bff4-7442fbabcbe1 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:00.452117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e16b79-4572-4bef-bff4-7442fbabcbe1 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:00.453753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 157/315] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:00.459025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca428d-a691-445e-a1d8-011ce05024ec None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:00.459453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca428d-a691-445e-a1d8-011ce05024ec None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:00.459621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca428d-a691-445e-a1d8-011ce05024ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:00.482221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5bca428d-a691-445e-a1d8-011ce05024ec None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:00.483882 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5bca428d-a691-445e-a1d8-011ce05024ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:00.490427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 159/316] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:00 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:00.512964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e16b79-4572-4bef-bff4-7442fbabcbe1 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:00.525629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e16b79-4572-4bef-bff4-7442fbabcbe1 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:00.529456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32e71-6e75-460c-a2bc-4c7139ae5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:00.530178 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32e71-6e75-460c-a2bc-4c7139ae5b0c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:00.530473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32e71-6e75-460c-a2bc-4c7139ae5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:00.530741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32e71-6e75-460c-a2bc-4c7139ae5b0c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:00.542042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32e71-6e75-460c-a2bc-4c7139ae5b0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:00.549998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-89d32e71-6e75-460c-a2bc-4c7139ae5b0c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:39:00.551335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 158/317] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:39:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:00.559746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca428d-a691-445e-a1d8-011ce05024ec None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:00.569215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca428d-a691-445e-a1d8-011ce05024ec None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:00.573210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f99f99-8110-474f-982a-f612876092c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:00.573803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f99f99-8110-474f-982a-f612876092c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:00.574090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f99f99-8110-474f-982a-f612876092c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:00.574377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f99f99-8110-474f-982a-f612876092c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:00.575085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f99f99-8110-474f-982a-f612876092c5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:00.575420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f99f99-8110-474f-982a-f612876092c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:00.601382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f99f99-8110-474f-982a-f612876092c5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:00.610695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 160/318] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:00.616304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32e71-6e75-460c-a2bc-4c7139ae5b0c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:00.627956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32e71-6e75-460c-a2bc-4c7139ae5b0c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:00.631884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd08699-8797-4a71-adbe-ed4abb94654e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:00.632660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd08699-8797-4a71-adbe-ed4abb94654e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:00.632950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd08699-8797-4a71-adbe-ed4abb94654e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:00.633237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd08699-8797-4a71-adbe-ed4abb94654e admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:00.634300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd08699-8797-4a71-adbe-ed4abb94654e admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:00.660252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd08699-8797-4a71-adbe-ed4abb94654e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:00.661979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 159/319] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:39:00 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:00.667449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f99f99-8110-474f-982a-f612876092c5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:00.677146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f99f99-8110-474f-982a-f612876092c5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:00.681140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12776a-0f29-45f1-8617-924dd283cec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:00.681913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12776a-0f29-45f1-8617-924dd283cec2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:00.682202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12776a-0f29-45f1-8617-924dd283cec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:00.682484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12776a-0f29-45f1-8617-924dd283cec2 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:00.683598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12776a-0f29-45f1-8617-924dd283cec2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:00.710744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12776a-0f29-45f1-8617-924dd283cec2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:00.712328 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 161/320] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:39:00 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:00.718481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd08699-8797-4a71-adbe-ed4abb94654e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:00.727930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd08699-8797-4a71-adbe-ed4abb94654e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:00.731812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba0ae-ddb3-495c-8468-457b60729d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:00.732702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba0ae-ddb3-495c-8468-457b60729d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:00.732932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba0ae-ddb3-495c-8468-457b60729d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:00.733210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba0ae-ddb3-495c-8468-457b60729d2a admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/groups/3bff9f4b0d4444ad80a377104104cb63/roles/3876294260db4719972a530e23d90b2f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:00.735124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba0ae-ddb3-495c-8468-457b60729d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d, group_id=3bff9f4b0d4444ad80a377104104cb63, role_id=3876294260db4719972a530e23d90b2f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:00.761265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba0ae-ddb3-495c-8468-457b60729d2a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:00.854605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 160/321] 10.222.0.87 () {58 vars in 1463 bytes} [Tue Jan 18 12:39:00 2022] PUT /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d/groups/3bff9f4b0d4444ad80a377104104cb63/roles/3876294260db4719972a530e23d90b2f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:39:02.828848 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30095e2-869d-4aad-8dcd-815b61a9b70a None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:02.829375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30095e2-869d-4aad-8dcd-815b61a9b70a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:02.829483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30095e2-869d-4aad-8dcd-815b61a9b70a None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:02.831059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 162/322] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:02.836301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a05696-abcd-41da-9448-cf89ee2a6277 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:02.836736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a05696-abcd-41da-9448-cf89ee2a6277 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:02.836865 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a05696-abcd-41da-9448-cf89ee2a6277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:02.859132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-60a05696-abcd-41da-9448-cf89ee2a6277 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:02.860278 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-60a05696-abcd-41da-9448-cf89ee2a6277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:02.923198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 161/323] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:02 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:02.946289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30095e2-869d-4aad-8dcd-815b61a9b70a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:02.957726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30095e2-869d-4aad-8dcd-815b61a9b70a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:02.961561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1586f-9b4a-4a80-b5ac-12f54224701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:02.962277 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1586f-9b4a-4a80-b5ac-12f54224701c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:02.962561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1586f-9b4a-4a80-b5ac-12f54224701c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:02.962836 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1586f-9b4a-4a80-b5ac-12f54224701c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:02.974505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1586f-9b4a-4a80-b5ac-12f54224701c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:02.981303 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-f8a1586f-9b4a-4a80-b5ac-12f54224701c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:39:02.982881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 163/324] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:39:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:02.988637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a05696-abcd-41da-9448-cf89ee2a6277 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:02.997163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a05696-abcd-41da-9448-cf89ee2a6277 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:03.001913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794e4c-6d3d-4a9e-97e5-468eab7b1acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:03.002508 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794e4c-6d3d-4a9e-97e5-468eab7b1acd admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:03.002802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794e4c-6d3d-4a9e-97e5-468eab7b1acd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:03.003085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794e4c-6d3d-4a9e-97e5-468eab7b1acd admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:03.003844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794e4c-6d3d-4a9e-97e5-468eab7b1acd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:03.004148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794e4c-6d3d-4a9e-97e5-468eab7b1acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:03.029397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794e4c-6d3d-4a9e-97e5-468eab7b1acd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:03.038097 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 162/325] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:03.043558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1586f-9b4a-4a80-b5ac-12f54224701c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:03.053570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1586f-9b4a-4a80-b5ac-12f54224701c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:03.057647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c063ad-3294-47c6-b3d4-7ae2dfcaa2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:03.058209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c063ad-3294-47c6-b3d4-7ae2dfcaa2ae admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:03.058492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c063ad-3294-47c6-b3d4-7ae2dfcaa2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:03.058768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c063ad-3294-47c6-b3d4-7ae2dfcaa2ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:03.066784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c063ad-3294-47c6-b3d4-7ae2dfcaa2ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:03.092457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c063ad-3294-47c6-b3d4-7ae2dfcaa2ae admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:03.101196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 164/326] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:39:03 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:39:03.106832 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794e4c-6d3d-4a9e-97e5-468eab7b1acd admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:03.117003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794e4c-6d3d-4a9e-97e5-468eab7b1acd admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:03.120994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0b59-3108-423a-848c-30a559af7ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:03.121772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0b59-3108-423a-848c-30a559af7ced admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:03.122061 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0b59-3108-423a-848c-30a559af7ced admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:03.122345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d0b59-3108-423a-848c-30a559af7ced admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:03.124122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d0b59-3108-423a-848c-30a559af7ced admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:03.150169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d0b59-3108-423a-848c-30a559af7ced admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:03.151764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 163/327] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:39:03 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:03.157130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c063ad-3294-47c6-b3d4-7ae2dfcaa2ae admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:03.165745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c063ad-3294-47c6-b3d4-7ae2dfcaa2ae admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:03.170347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468797ee-44de-4e36-b402-7fef82014ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:03.171277 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468797ee-44de-4e36-b402-7fef82014ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:03.171596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468797ee-44de-4e36-b402-7fef82014ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:03.171877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468797ee-44de-4e36-b402-7fef82014ee3 admin admin] PATH_INFO: `/v3/groups/3bff9f4b0d4444ad80a377104104cb63` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:03.172928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468797ee-44de-4e36-b402-7fef82014ee3 admin admin] RBAC: Authorizing `identity:get_group(group_id=3bff9f4b0d4444ad80a377104104cb63)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:03.199056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468797ee-44de-4e36-b402-7fef82014ee3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:03.200525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 165/328] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:39:03 2022] GET /identity/v3/groups/3bff9f4b0d4444ad80a377104104cb63 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:03.206690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0b59-3108-423a-848c-30a559af7ced admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:03.216059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d0b59-3108-423a-848c-30a559af7ced admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:03.220656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f1ed7-f37b-42ed-afbd-e933086d046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:03.221225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f1ed7-f37b-42ed-afbd-e933086d046c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:03.221514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f1ed7-f37b-42ed-afbd-e933086d046c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:03.221795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f1ed7-f37b-42ed-afbd-e933086d046c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:03.222566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f1ed7-f37b-42ed-afbd-e933086d046c admin admin] RBAC: Adding query filter params (group.id=3bff9f4b0d4444ad80a377104104cb63, role.id=3876294260db4719972a530e23d90b2f, scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:03.222870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f1ed7-f37b-42ed-afbd-e933086d046c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:03.248235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f1ed7-f37b-42ed-afbd-e933086d046c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:03.253941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 164/329] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:39:03 2022] GET /identity/v3/role_assignments?group.id=3bff9f4b0d4444ad80a377104104cb63&scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d&role.id=3876294260db4719972a530e23d90b2f => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:05.247990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd869ea-5093-499a-9b56-ea5e90af07d7 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:05.248508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd869ea-5093-499a-9b56-ea5e90af07d7 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:05.248622 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd869ea-5093-499a-9b56-ea5e90af07d7 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:05.250269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 166/330] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:05.255237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45dfe9-65e5-4919-b3d9-f2407ee5da55 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:05.255667 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45dfe9-65e5-4919-b3d9-f2407ee5da55 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:05.255842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45dfe9-65e5-4919-b3d9-f2407ee5da55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:05.279095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ba45dfe9-65e5-4919-b3d9-f2407ee5da55 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:05.281096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ba45dfe9-65e5-4919-b3d9-f2407ee5da55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:05.288094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 165/331] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:05 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:05.317455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd869ea-5093-499a-9b56-ea5e90af07d7 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:05.330803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd869ea-5093-499a-9b56-ea5e90af07d7 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:05.335130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501070b-16bc-4779-b3fe-92777612cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:05.335869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501070b-16bc-4779-b3fe-92777612cd7b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:05.336160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501070b-16bc-4779-b3fe-92777612cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:05.336443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501070b-16bc-4779-b3fe-92777612cd7b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:05.349236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501070b-16bc-4779-b3fe-92777612cd7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:05.355433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-8501070b-16bc-4779-b3fe-92777612cd7b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:39:05.356541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 167/332] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:39:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:05.362254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45dfe9-65e5-4919-b3d9-f2407ee5da55 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:05.370828 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45dfe9-65e5-4919-b3d9-f2407ee5da55 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:05.374793 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86732ed-95d9-499f-afba-ee8b38dab3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:05.375431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86732ed-95d9-499f-afba-ee8b38dab3cf admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:05.375724 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86732ed-95d9-499f-afba-ee8b38dab3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:05.376006 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86732ed-95d9-499f-afba-ee8b38dab3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:05.376717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86732ed-95d9-499f-afba-ee8b38dab3cf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:05.377018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86732ed-95d9-499f-afba-ee8b38dab3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:05.402842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86732ed-95d9-499f-afba-ee8b38dab3cf admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:05.412366 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 166/333] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:39:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:05.417773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501070b-16bc-4779-b3fe-92777612cd7b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:05.427982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501070b-16bc-4779-b3fe-92777612cd7b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:05.431831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9cb2e-6916-452b-8e18-f9a46044184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:05.432391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9cb2e-6916-452b-8e18-f9a46044184d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:05.432681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9cb2e-6916-452b-8e18-f9a46044184d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:05.432964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9cb2e-6916-452b-8e18-f9a46044184d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:05.440809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9cb2e-6916-452b-8e18-f9a46044184d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:05.467180 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9cb2e-6916-452b-8e18-f9a46044184d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:05.475623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 168/334] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:39:05 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:39:05.481057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86732ed-95d9-499f-afba-ee8b38dab3cf admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:05.490259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86732ed-95d9-499f-afba-ee8b38dab3cf admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:05.494045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb63bd0-8b7c-48b6-a0dd-f519f07c9a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:05.494821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb63bd0-8b7c-48b6-a0dd-f519f07c9a46 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:05.495104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb63bd0-8b7c-48b6-a0dd-f519f07c9a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:05.495418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb63bd0-8b7c-48b6-a0dd-f519f07c9a46 admin admin] PATH_INFO: `/v3/projects/efd990fcb71545ffb5735fe49db625b4` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:05.496482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb63bd0-8b7c-48b6-a0dd-f519f07c9a46 admin admin] RBAC: Authorizing `identity:get_project(project_id=efd990fcb71545ffb5735fe49db625b4)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:05.522769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb63bd0-8b7c-48b6-a0dd-f519f07c9a46 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:05.524396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 167/335] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:39:05 2022] GET /identity/v3/projects/efd990fcb71545ffb5735fe49db625b4 => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:05.530503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9cb2e-6916-452b-8e18-f9a46044184d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:05.539428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9cb2e-6916-452b-8e18-f9a46044184d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:05.543410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630ae7d-5a1c-4347-8895-e8e803594ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:05.544180 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630ae7d-5a1c-4347-8895-e8e803594ade admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:05.544470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630ae7d-5a1c-4347-8895-e8e803594ade admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:05.544750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630ae7d-5a1c-4347-8895-e8e803594ade admin admin] PATH_INFO: `/v3/groups/602d3d35ab7e430aac225af9524681ac` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:05.549380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630ae7d-5a1c-4347-8895-e8e803594ade admin admin] RBAC: Authorizing `identity:get_group(group_id=602d3d35ab7e430aac225af9524681ac)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:05.576452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630ae7d-5a1c-4347-8895-e8e803594ade admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:05.577975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 169/336] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:39:05 2022] GET /identity/v3/groups/602d3d35ab7e430aac225af9524681ac => generated 229 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:05.583614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb63bd0-8b7c-48b6-a0dd-f519f07c9a46 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:05.593133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb63bd0-8b7c-48b6-a0dd-f519f07c9a46 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:05.597011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849ab23-3fb1-45d7-a1a6-f34976d661bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:05.597583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849ab23-3fb1-45d7-a1a6-f34976d661bb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:05.597870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849ab23-3fb1-45d7-a1a6-f34976d661bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:05.598152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849ab23-3fb1-45d7-a1a6-f34976d661bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:05.598921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849ab23-3fb1-45d7-a1a6-f34976d661bb admin admin] RBAC: Adding query filter params (group.id=602d3d35ab7e430aac225af9524681ac, role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=efd990fcb71545ffb5735fe49db625b4) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:05.599224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849ab23-3fb1-45d7-a1a6-f34976d661bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:05.626543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849ab23-3fb1-45d7-a1a6-f34976d661bb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:05.635758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 168/337] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:39:05 2022] GET /identity/v3/role_assignments?group.id=602d3d35ab7e430aac225af9524681ac&scope.project.id=efd990fcb71545ffb5735fe49db625b4&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 260 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:07.590774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8357b-61d3-4e40-84fa-122b751472be None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:07.591322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8357b-61d3-4e40-84fa-122b751472be None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:07.591512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8357b-61d3-4e40-84fa-122b751472be None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:07.593190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 170/338] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:07.598218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33866383-c592-40d9-ad53-6c10332b9171 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:07.598635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33866383-c592-40d9-ad53-6c10332b9171 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:07.598786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33866383-c592-40d9-ad53-6c10332b9171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:07.623073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-33866383-c592-40d9-ad53-6c10332b9171 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:07.624228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-33866383-c592-40d9-ad53-6c10332b9171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:07.630877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 169/339] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:07 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:07.652233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8357b-61d3-4e40-84fa-122b751472be None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:07.663971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8357b-61d3-4e40-84fa-122b751472be None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:07.667920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa7e7a-2d92-4710-ac91-c199eafc7697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:07.668619 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa7e7a-2d92-4710-ac91-c199eafc7697 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:07.668907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa7e7a-2d92-4710-ac91-c199eafc7697 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:07.669718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa7e7a-2d92-4710-ac91-c199eafc7697 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:07.681669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa7e7a-2d92-4710-ac91-c199eafc7697 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:07.688870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-35aa7e7a-2d92-4710-ac91-c199eafc7697 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:39:07.689956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 171/340] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:07.696105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33866383-c592-40d9-ad53-6c10332b9171 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:07.704765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33866383-c592-40d9-ad53-6c10332b9171 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:07.708717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96704f3-2c9b-4e7a-862c-1aeb56f9b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:07.709305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96704f3-2c9b-4e7a-862c-1aeb56f9b9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:07.709590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96704f3-2c9b-4e7a-862c-1aeb56f9b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:07.709870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96704f3-2c9b-4e7a-862c-1aeb56f9b9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:07.710584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96704f3-2c9b-4e7a-862c-1aeb56f9b9a0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:07.710881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96704f3-2c9b-4e7a-862c-1aeb56f9b9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:07.736439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96704f3-2c9b-4e7a-862c-1aeb56f9b9a0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:07.744852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 170/341] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:07.750837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa7e7a-2d92-4710-ac91-c199eafc7697 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:07.760913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa7e7a-2d92-4710-ac91-c199eafc7697 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:07.764995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1063d7-93ca-421a-bfbd-da1aff830c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:07.765759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1063d7-93ca-421a-bfbd-da1aff830c83 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:07.766043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1063d7-93ca-421a-bfbd-da1aff830c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:07.766322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1063d7-93ca-421a-bfbd-da1aff830c83 admin admin] PATH_INFO: `/v3/groups/602d3d35ab7e430aac225af9524681ac` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:07.767396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1063d7-93ca-421a-bfbd-da1aff830c83 admin admin] RBAC: Authorizing `identity:get_group(group_id=602d3d35ab7e430aac225af9524681ac)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:07.793133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1063d7-93ca-421a-bfbd-da1aff830c83 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:07.795360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 172/342] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:39:07 2022] GET /identity/v3/groups/602d3d35ab7e430aac225af9524681ac => generated 229 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:07.800490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96704f3-2c9b-4e7a-862c-1aeb56f9b9a0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:07.810520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96704f3-2c9b-4e7a-862c-1aeb56f9b9a0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:07.814494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0585f-3868-4d2c-af07-b5a87a5e5cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:07.815275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0585f-3868-4d2c-af07-b5a87a5e5cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:07.815594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0585f-3868-4d2c-af07-b5a87a5e5cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:07.815879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0585f-3868-4d2c-af07-b5a87a5e5cb8 admin admin] PATH_INFO: `/v3/projects/efd990fcb71545ffb5735fe49db625b4` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:07.816961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0585f-3868-4d2c-af07-b5a87a5e5cb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=efd990fcb71545ffb5735fe49db625b4)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:07.842765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0585f-3868-4d2c-af07-b5a87a5e5cb8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:07.844286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 171/343] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:39:07 2022] GET /identity/v3/projects/efd990fcb71545ffb5735fe49db625b4 => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:07.849586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1063d7-93ca-421a-bfbd-da1aff830c83 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:07.859457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1063d7-93ca-421a-bfbd-da1aff830c83 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:07.863521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde774-57c7-4e77-a6a8-0fba3e41fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:07.864314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde774-57c7-4e77-a6a8-0fba3e41fbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:07.864608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde774-57c7-4e77-a6a8-0fba3e41fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:07.864891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde774-57c7-4e77-a6a8-0fba3e41fbf9 admin admin] PATH_INFO: `/v3/projects/efd990fcb71545ffb5735fe49db625b4/groups/602d3d35ab7e430aac225af9524681ac/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:07.866588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cde774-57c7-4e77-a6a8-0fba3e41fbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd990fcb71545ffb5735fe49db625b4, group_id=602d3d35ab7e430aac225af9524681ac, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:07.893295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cde774-57c7-4e77-a6a8-0fba3e41fbf9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:07.991864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 173/344] 10.222.0.87 () {58 vars in 1463 bytes} [Tue Jan 18 12:39:07 2022] PUT /identity/v3/projects/efd990fcb71545ffb5735fe49db625b4/groups/602d3d35ab7e430aac225af9524681ac/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:39:09.945069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9213-ed93-4a3a-85a8-c18249144d75 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:09.945651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9213-ed93-4a3a-85a8-c18249144d75 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:09.945651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9213-ed93-4a3a-85a8-c18249144d75 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:09.947297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 172/345] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:09.952475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd265e0-c9a4-4b26-b0e2-2f39d430b337 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:09.952950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd265e0-c9a4-4b26-b0e2-2f39d430b337 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:09.953049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd265e0-c9a4-4b26-b0e2-2f39d430b337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:09.974767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-8cd265e0-c9a4-4b26-b0e2-2f39d430b337 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:09.975914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-8cd265e0-c9a4-4b26-b0e2-2f39d430b337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:10.040500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 174/346] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:09 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:39:10.063813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9213-ed93-4a3a-85a8-c18249144d75 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:10.075243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9213-ed93-4a3a-85a8-c18249144d75 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:10.079200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24076815-8d7f-4387-a69c-4c51034f02e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:10.080000 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24076815-8d7f-4387-a69c-4c51034f02e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:10.080352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24076815-8d7f-4387-a69c-4c51034f02e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:10.080701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24076815-8d7f-4387-a69c-4c51034f02e6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:10.093207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24076815-8d7f-4387-a69c-4c51034f02e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:10.099542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-24076815-8d7f-4387-a69c-4c51034f02e6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:39:10.100631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 173/347] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:39:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:10.106240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd265e0-c9a4-4b26-b0e2-2f39d430b337 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:10.115501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd265e0-c9a4-4b26-b0e2-2f39d430b337 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:10.119404 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f311f68-08a4-4e92-8054-9586ad6e05ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:10.119986 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311f68-08a4-4e92-8054-9586ad6e05ed admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:10.120271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311f68-08a4-4e92-8054-9586ad6e05ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:10.120551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f311f68-08a4-4e92-8054-9586ad6e05ed admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:10.121250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f311f68-08a4-4e92-8054-9586ad6e05ed admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:10.121547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f311f68-08a4-4e92-8054-9586ad6e05ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:10.146775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f311f68-08a4-4e92-8054-9586ad6e05ed admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:10.155760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 175/348] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:39:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:10.161682 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24076815-8d7f-4387-a69c-4c51034f02e6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:10.171964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24076815-8d7f-4387-a69c-4c51034f02e6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:10.176010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb241b-b653-4dc4-98da-9fc45da7941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:10.176575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb241b-b653-4dc4-98da-9fc45da7941c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:10.176862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb241b-b653-4dc4-98da-9fc45da7941c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:10.177142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb241b-b653-4dc4-98da-9fc45da7941c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:10.184851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb241b-b653-4dc4-98da-9fc45da7941c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:10.210788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb241b-b653-4dc4-98da-9fc45da7941c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:10.220575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 174/349] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:39:10 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 12:39:10.226309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f311f68-08a4-4e92-8054-9586ad6e05ed admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:10.236703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f311f68-08a4-4e92-8054-9586ad6e05ed admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:10.240926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2677208-96da-47ec-92ed-b635162da052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:10.241705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2677208-96da-47ec-92ed-b635162da052 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:10.241997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2677208-96da-47ec-92ed-b635162da052 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:10.242280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2677208-96da-47ec-92ed-b635162da052 admin admin] PATH_INFO: `/v3/projects/efd990fcb71545ffb5735fe49db625b4` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:10.243384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2677208-96da-47ec-92ed-b635162da052 admin admin] RBAC: Authorizing `identity:get_project(project_id=efd990fcb71545ffb5735fe49db625b4)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:10.269218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2677208-96da-47ec-92ed-b635162da052 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:10.270772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 176/350] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:39:10 2022] GET /identity/v3/projects/efd990fcb71545ffb5735fe49db625b4 => generated 344 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:10.276346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb241b-b653-4dc4-98da-9fc45da7941c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:10.285737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb241b-b653-4dc4-98da-9fc45da7941c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:10.289649 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a4470-1c1d-4ba7-84e6-37b2e3ddd233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:10.290417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4470-1c1d-4ba7-84e6-37b2e3ddd233 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:10.290700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4470-1c1d-4ba7-84e6-37b2e3ddd233 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:10.290975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a4470-1c1d-4ba7-84e6-37b2e3ddd233 admin admin] PATH_INFO: `/v3/groups/602d3d35ab7e430aac225af9524681ac` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:10.292044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a4470-1c1d-4ba7-84e6-37b2e3ddd233 admin admin] RBAC: Authorizing `identity:get_group(group_id=602d3d35ab7e430aac225af9524681ac)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:10.319404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a4470-1c1d-4ba7-84e6-37b2e3ddd233 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:10.320891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 175/351] 10.222.0.87 () {56 vars in 1201 bytes} [Tue Jan 18 12:39:10 2022] GET /identity/v3/groups/602d3d35ab7e430aac225af9524681ac => generated 229 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:10.326738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2677208-96da-47ec-92ed-b635162da052 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:10.336151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2677208-96da-47ec-92ed-b635162da052 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:10.340089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa06a4e-4a66-4793-9ef1-ee821ab5a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:10.340655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06a4e-4a66-4793-9ef1-ee821ab5a818 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:10.341491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06a4e-4a66-4793-9ef1-ee821ab5a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:10.341794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa06a4e-4a66-4793-9ef1-ee821ab5a818 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:10.342563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06a4e-4a66-4793-9ef1-ee821ab5a818 admin admin] RBAC: Adding query filter params (group.id=602d3d35ab7e430aac225af9524681ac, role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=efd990fcb71545ffb5735fe49db625b4) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:10.342868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06a4e-4a66-4793-9ef1-ee821ab5a818 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:10.368885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa06a4e-4a66-4793-9ef1-ee821ab5a818 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:10.374756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 177/352] 10.222.0.87 () {56 vars in 1397 bytes} [Tue Jan 18 12:39:10 2022] GET /identity/v3/role_assignments?group.id=602d3d35ab7e430aac225af9524681ac&scope.project.id=efd990fcb71545ffb5735fe49db625b4&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 611 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:12.442770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaf539-5e57-43d4-8dc5-3f32c5224279 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:12.443280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaf539-5e57-43d4-8dc5-3f32c5224279 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:12.443280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcaf539-5e57-43d4-8dc5-3f32c5224279 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:12.444974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 176/353] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:12.450340 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dab9b-7693-4e8d-9886-7b1dd1b2b686 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:12.450744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dab9b-7693-4e8d-9886-7b1dd1b2b686 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:12.450903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dab9b-7693-4e8d-9886-7b1dd1b2b686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:12.473665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-794dab9b-7693-4e8d-9886-7b1dd1b2b686 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:12.474781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-794dab9b-7693-4e8d-9886-7b1dd1b2b686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:12.481497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 178/354] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:12 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:12.505425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaf539-5e57-43d4-8dc5-3f32c5224279 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:12.517130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcaf539-5e57-43d4-8dc5-3f32c5224279 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:12.520960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265ab85-df0d-4380-9f34-fb2fa99fde1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:12.521678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265ab85-df0d-4380-9f34-fb2fa99fde1e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:12.521963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265ab85-df0d-4380-9f34-fb2fa99fde1e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:12.522240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265ab85-df0d-4380-9f34-fb2fa99fde1e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:12.535483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265ab85-df0d-4380-9f34-fb2fa99fde1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:12.561384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265ab85-df0d-4380-9f34-fb2fa99fde1e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:12.578289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-7265ab85-df0d-4380-9f34-fb2fa99fde1e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:12.579382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 177/355] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:12.585193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dab9b-7693-4e8d-9886-7b1dd1b2b686 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:12.594343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dab9b-7693-4e8d-9886-7b1dd1b2b686 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:12.598311 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3012f37-46a7-410d-ae2a-c91510766248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:12.598892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3012f37-46a7-410d-ae2a-c91510766248 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:12.599183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3012f37-46a7-410d-ae2a-c91510766248 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:12.599502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3012f37-46a7-410d-ae2a-c91510766248 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:12.600180 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3012f37-46a7-410d-ae2a-c91510766248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:12.600483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3012f37-46a7-410d-ae2a-c91510766248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:12.626932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3012f37-46a7-410d-ae2a-c91510766248 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:12.644035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 179/356] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:12.649524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265ab85-df0d-4380-9f34-fb2fa99fde1e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:12.658913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265ab85-df0d-4380-9f34-fb2fa99fde1e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:12.663028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e034c-02e6-4239-904a-41efdd91605c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:12.663646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e034c-02e6-4239-904a-41efdd91605c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:12.663931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e034c-02e6-4239-904a-41efdd91605c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:12.664209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e034c-02e6-4239-904a-41efdd91605c admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:12.664844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e034c-02e6-4239-904a-41efdd91605c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:12.690490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-6c4e034c-02e6-4239-904a-41efdd91605c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:12.690490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:39:12.690490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:39:12.691691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e034c-02e6-4239-904a-41efdd91605c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:12.822253 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 178/357] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:39:12 2022] POST /identity/v3/users => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:39:14.825604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982241f2-c70c-4c6b-832a-69812239c0eb None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:14.826156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982241f2-c70c-4c6b-832a-69812239c0eb None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:14.826348 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982241f2-c70c-4c6b-832a-69812239c0eb None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:14.828080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 180/358] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:14.833381 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250f20a-82db-4033-ac18-4b3cbd139d5d None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:14.833814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250f20a-82db-4033-ac18-4b3cbd139d5d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:14.833941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250f20a-82db-4033-ac18-4b3cbd139d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:14.858044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-8250f20a-82db-4033-ac18-4b3cbd139d5d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:14.859240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8250f20a-82db-4033-ac18-4b3cbd139d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:14.866237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 179/359] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:14 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:14.890144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982241f2-c70c-4c6b-832a-69812239c0eb None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:14.901701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982241f2-c70c-4c6b-832a-69812239c0eb None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:14.906530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f16c7-08b1-4e26-9945-a16b79247833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:14.907242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f16c7-08b1-4e26-9945-a16b79247833 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:14.907561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f16c7-08b1-4e26-9945-a16b79247833 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:14.907845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f16c7-08b1-4e26-9945-a16b79247833 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:14.919976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f16c7-08b1-4e26-9945-a16b79247833 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:14.926326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-638f16c7-08b1-4e26-9945-a16b79247833 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:39:14.927414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 181/360] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:39:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:14.933147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250f20a-82db-4033-ac18-4b3cbd139d5d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:14.941821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250f20a-82db-4033-ac18-4b3cbd139d5d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:14.945804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eda78-36c1-4d66-9ec6-88e785ed151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:14.946393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eda78-36c1-4d66-9ec6-88e785ed151c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:14.946678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eda78-36c1-4d66-9ec6-88e785ed151c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:14.946960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eda78-36c1-4d66-9ec6-88e785ed151c admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:14.947703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eda78-36c1-4d66-9ec6-88e785ed151c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:14.948004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eda78-36c1-4d66-9ec6-88e785ed151c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:14.974695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eda78-36c1-4d66-9ec6-88e785ed151c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:14.983472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 180/361] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:39:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:39:14.989031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f16c7-08b1-4e26-9945-a16b79247833 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.000029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f16c7-08b1-4e26-9945-a16b79247833 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.003967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ee6c3-a5f1-4a1d-b3ea-978fd7366105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.004680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ee6c3-a5f1-4a1d-b3ea-978fd7366105 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.004974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ee6c3-a5f1-4a1d-b3ea-978fd7366105 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.005255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ee6c3-a5f1-4a1d-b3ea-978fd7366105 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.017061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ee6c3-a5f1-4a1d-b3ea-978fd7366105 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.043222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ee6c3-a5f1-4a1d-b3ea-978fd7366105 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.061357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-868ee6c3-a5f1-4a1d-b3ea-978fd7366105 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:15.062467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 182/362] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:15.067906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eda78-36c1-4d66-9ec6-88e785ed151c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.077872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eda78-36c1-4d66-9ec6-88e785ed151c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.081738 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.082322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.082608 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.082888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.083610 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:15.083911 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.110816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:15.110816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:39:15.110816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:39:15.111735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.125860 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 181/363] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:15.131534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ee6c3-a5f1-4a1d-b3ea-978fd7366105 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.141029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ee6c3-a5f1-4a1d-b3ea-978fd7366105 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.145062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8179-9c4b-46d5-8e94-cc3bb03aef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.145777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8179-9c4b-46d5-8e94-cc3bb03aef59 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.146065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8179-9c4b-46d5-8e94-cc3bb03aef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.146347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c8179-9c4b-46d5-8e94-cc3bb03aef59 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.159985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c8179-9c4b-46d5-8e94-cc3bb03aef59 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.188006 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c8179-9c4b-46d5-8e94-cc3bb03aef59 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.206441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-c40c8179-9c4b-46d5-8e94-cc3bb03aef59 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 18 12:39:15.207627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 183/364] 10.222.0.87 () {56 vars in 1114 bytes} [Tue Jan 18 12:39:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:15.213397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.223329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0227f-1afe-4ba8-8d85-b79390522156 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.227605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.228211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.228499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.228779 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.229621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:15.229918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.260675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:15.260675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:39:15.260675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:39:15.261889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.298259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 182/365] 10.222.0.87 () {56 vars in 1154 bytes} [Tue Jan 18 12:39:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:39:15.304774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8179-9c4b-46d5-8e94-cc3bb03aef59 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.321607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c8179-9c4b-46d5-8e94-cc3bb03aef59 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.325691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a01e1e-dcb4-422d-8b2a-64e37384ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.326606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a01e1e-dcb4-422d-8b2a-64e37384ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.327060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a01e1e-dcb4-422d-8b2a-64e37384ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.327562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a01e1e-dcb4-422d-8b2a-64e37384ff90 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.341562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a01e1e-dcb4-422d-8b2a-64e37384ff90 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.367485 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a01e1e-dcb4-422d-8b2a-64e37384ff90 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.376572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 184/366] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:39:15 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:39:15.382221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.391764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4eceb-7596-4d70-adf2-9adfc0f9f7e8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.395922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25567760-f6a9-4410-9126-f172ca4e87d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.396638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25567760-f6a9-4410-9126-f172ca4e87d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.396922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25567760-f6a9-4410-9126-f172ca4e87d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.397374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25567760-f6a9-4410-9126-f172ca4e87d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.410317 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25567760-f6a9-4410-9126-f172ca4e87d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.437464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25567760-f6a9-4410-9126-f172ca4e87d5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.455486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-25567760-f6a9-4410-9126-f172ca4e87d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:15.456615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 183/367] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:15.462089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a01e1e-dcb4-422d-8b2a-64e37384ff90 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.470891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a01e1e-dcb4-422d-8b2a-64e37384ff90 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.474957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cafb6e-378d-4d9c-bd2f-f3a9c60b7989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.475661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cafb6e-378d-4d9c-bd2f-f3a9c60b7989 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.475951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cafb6e-378d-4d9c-bd2f-f3a9c60b7989 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.476230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cafb6e-378d-4d9c-bd2f-f3a9c60b7989 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.476905 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cafb6e-378d-4d9c-bd2f-f3a9c60b7989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:15.477201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cafb6e-378d-4d9c-bd2f-f3a9c60b7989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.503623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cafb6e-378d-4d9c-bd2f-f3a9c60b7989 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.517516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 185/368] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:15.523005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25567760-f6a9-4410-9126-f172ca4e87d5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.532626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25567760-f6a9-4410-9126-f172ca4e87d5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.536804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320339d-9585-41e5-8614-fa824eb577fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.537508 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320339d-9585-41e5-8614-fa824eb577fa admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.537787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320339d-9585-41e5-8614-fa824eb577fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.538058 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320339d-9585-41e5-8614-fa824eb577fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.546943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320339d-9585-41e5-8614-fa824eb577fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.573237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320339d-9585-41e5-8614-fa824eb577fa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.587506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-d320339d-9585-41e5-8614-fa824eb577fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:39:15.588568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 184/369] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:15.598465 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cafb6e-378d-4d9c-bd2f-f3a9c60b7989 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.603529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cafb6e-378d-4d9c-bd2f-f3a9c60b7989 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.607740 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0126-6112-4c60-a5f9-d214a37e52a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.608318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0126-6112-4c60-a5f9-d214a37e52a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.608602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0126-6112-4c60-a5f9-d214a37e52a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.608880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0126-6112-4c60-a5f9-d214a37e52a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.609612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0126-6112-4c60-a5f9-d214a37e52a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:15.609908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0126-6112-4c60-a5f9-d214a37e52a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.634883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-64cc0126-6112-4c60-a5f9-d214a37e52a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:15.634883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:39:15.634883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:39:15.636028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0126-6112-4c60-a5f9-d214a37e52a9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.650021 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 186/370] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:15.655978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320339d-9585-41e5-8614-fa824eb577fa admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:15.665821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320339d-9585-41e5-8614-fa824eb577fa admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:15.670225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d3cae-b579-43c6-9db2-9ce408226b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:15.670804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d3cae-b579-43c6-9db2-9ce408226b91 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:15.671090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d3cae-b579-43c6-9db2-9ce408226b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:15.671396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d3cae-b579-43c6-9db2-9ce408226b91 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:15.672178 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d3cae-b579-43c6-9db2-9ce408226b91 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=394a96c082ed47bbbd645b489a4ed208) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:15.672479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d3cae-b579-43c6-9db2-9ce408226b91 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:15.713130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d3cae-b579-43c6-9db2-9ce408226b91 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:15.722961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 185/371] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:39:15 2022] GET /identity/v3/role_assignments?user.id=394a96c082ed47bbbd645b489a4ed208&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 259 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:17.750878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283de0-fb90-415e-b647-1de0487817bc None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:17.751432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283de0-fb90-415e-b647-1de0487817bc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:17.751519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283de0-fb90-415e-b647-1de0487817bc None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:17.753143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 187/372] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:17.758216 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b522-78bb-4925-98a7-a27c1aadd6a9 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:17.758706 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b522-78bb-4925-98a7-a27c1aadd6a9 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:17.758797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b522-78bb-4925-98a7-a27c1aadd6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:17.781748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1c19b522-78bb-4925-98a7-a27c1aadd6a9 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:17.782896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1c19b522-78bb-4925-98a7-a27c1aadd6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:17.789826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 186/373] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:17 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:17.811475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b283de0-fb90-415e-b647-1de0487817bc None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:17.822829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b283de0-fb90-415e-b647-1de0487817bc None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:17.828661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3a26e-5ffe-476b-ae27-511a69353f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:17.829375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a26e-5ffe-476b-ae27-511a69353f9b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:17.829660 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a26e-5ffe-476b-ae27-511a69353f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:17.829943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3a26e-5ffe-476b-ae27-511a69353f9b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:17.841975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3a26e-5ffe-476b-ae27-511a69353f9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:17.848215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-42a3a26e-5ffe-476b-ae27-511a69353f9b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:39:17.849296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 188/374] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:17.854915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b522-78bb-4925-98a7-a27c1aadd6a9 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:17.864252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b522-78bb-4925-98a7-a27c1aadd6a9 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:17.868227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163514f-9b47-482e-bae0-e981734a2743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:17.868818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163514f-9b47-482e-bae0-e981734a2743 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:17.869115 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163514f-9b47-482e-bae0-e981734a2743 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:17.869397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163514f-9b47-482e-bae0-e981734a2743 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:17.870103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163514f-9b47-482e-bae0-e981734a2743 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:17.870404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163514f-9b47-482e-bae0-e981734a2743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:17.895982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163514f-9b47-482e-bae0-e981734a2743 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:17.904903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 187/375] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:17.910397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3a26e-5ffe-476b-ae27-511a69353f9b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:17.920480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3a26e-5ffe-476b-ae27-511a69353f9b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:17.924336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd17f3-4353-4ac1-a1d8-30727ed15d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:17.925032 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd17f3-4353-4ac1-a1d8-30727ed15d5b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:17.925318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd17f3-4353-4ac1-a1d8-30727ed15d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:17.925596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd17f3-4353-4ac1-a1d8-30727ed15d5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:17.936620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd17f3-4353-4ac1-a1d8-30727ed15d5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:17.962408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd17f3-4353-4ac1-a1d8-30727ed15d5b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:17.980082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-abbd17f3-4353-4ac1-a1d8-30727ed15d5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:17.981197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 189/376] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:17.986917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163514f-9b47-482e-bae0-e981734a2743 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:17.996221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163514f-9b47-482e-bae0-e981734a2743 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:18.000475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58fb7d-a1bd-401d-b8aa-e2b42a5d70c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:18.001106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58fb7d-a1bd-401d-b8aa-e2b42a5d70c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:18.001346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58fb7d-a1bd-401d-b8aa-e2b42a5d70c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:18.001629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd58fb7d-a1bd-401d-b8aa-e2b42a5d70c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:18.002308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58fb7d-a1bd-401d-b8aa-e2b42a5d70c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:18.002607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58fb7d-a1bd-401d-b8aa-e2b42a5d70c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:18.029083 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd58fb7d-a1bd-401d-b8aa-e2b42a5d70c7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:18.042065 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 188/377] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:18.047633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd17f3-4353-4ac1-a1d8-30727ed15d5b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:18.056958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd17f3-4353-4ac1-a1d8-30727ed15d5b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:18.060990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc52fc-06a6-4c9d-9694-612aa246c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:18.061766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc52fc-06a6-4c9d-9694-612aa246c892 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:18.062123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc52fc-06a6-4c9d-9694-612aa246c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:18.062494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc52fc-06a6-4c9d-9694-612aa246c892 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:18.075502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc52fc-06a6-4c9d-9694-612aa246c892 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:18.101681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc52fc-06a6-4c9d-9694-612aa246c892 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:18.119428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-4acc52fc-06a6-4c9d-9694-612aa246c892 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 18 12:39:18.120512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 190/378] 10.222.0.87 () {56 vars in 1114 bytes} [Tue Jan 18 12:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:18.126053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58fb7d-a1bd-401d-b8aa-e2b42a5d70c7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:18.135296 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd58fb7d-a1bd-401d-b8aa-e2b42a5d70c7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:18.140077 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f2ec9-bb0a-409f-9f03-f3e3ee579cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:18.140658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f2ec9-bb0a-409f-9f03-f3e3ee579cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:18.140943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f2ec9-bb0a-409f-9f03-f3e3ee579cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:18.141220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f2ec9-bb0a-409f-9f03-f3e3ee579cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:18.141996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f2ec9-bb0a-409f-9f03-f3e3ee579cb5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:18.142292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f2ec9-bb0a-409f-9f03-f3e3ee579cb5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:18.168666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f2ec9-bb0a-409f-9f03-f3e3ee579cb5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:18.274296 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 189/379] 10.222.0.87 () {56 vars in 1154 bytes} [Tue Jan 18 12:39:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:18.279731 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc52fc-06a6-4c9d-9694-612aa246c892 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:18.289175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc52fc-06a6-4c9d-9694-612aa246c892 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:18.293077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7545c1-bd18-45da-a4ba-428618fdc679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:18.294336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7545c1-bd18-45da-a4ba-428618fdc679 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:18.294603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7545c1-bd18-45da-a4ba-428618fdc679 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:18.294879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7545c1-bd18-45da-a4ba-428618fdc679 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:18.315505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7545c1-bd18-45da-a4ba-428618fdc679 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:18.342626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7545c1-bd18-45da-a4ba-428618fdc679 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:18.359788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-dd7545c1-bd18-45da-a4ba-428618fdc679 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:18.360873 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 191/380] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:18.366412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f2ec9-bb0a-409f-9f03-f3e3ee579cb5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:18.376423 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f2ec9-bb0a-409f-9f03-f3e3ee579cb5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:18.380325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294f1aa-db0a-449b-b3ae-559e124c0ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:18.380903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294f1aa-db0a-449b-b3ae-559e124c0ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:18.381185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294f1aa-db0a-449b-b3ae-559e124c0ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:18.381460 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294f1aa-db0a-449b-b3ae-559e124c0ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:18.382144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294f1aa-db0a-449b-b3ae-559e124c0ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:18.382438 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294f1aa-db0a-449b-b3ae-559e124c0ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:18.408490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294f1aa-db0a-449b-b3ae-559e124c0ff7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:18.422838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 190/381] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:39:18.428210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7545c1-bd18-45da-a4ba-428618fdc679 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:18.438011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7545c1-bd18-45da-a4ba-428618fdc679 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:18.441880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7344f3f-52e2-4de7-9245-50dc585dc4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:18.442578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344f3f-52e2-4de7-9245-50dc585dc4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:18.442861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344f3f-52e2-4de7-9245-50dc585dc4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:18.443139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7344f3f-52e2-4de7-9245-50dc585dc4f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:18.529012 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7344f3f-52e2-4de7-9245-50dc585dc4f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:18.554460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7344f3f-52e2-4de7-9245-50dc585dc4f4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:18.568375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-c7344f3f-52e2-4de7-9245-50dc585dc4f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:39:18.569441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 192/382] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:18.575290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294f1aa-db0a-449b-b3ae-559e124c0ff7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:18.584589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294f1aa-db0a-449b-b3ae-559e124c0ff7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:18.588468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4739333-7e28-4c4f-b1d3-4c510fdfc863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:18.589047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4739333-7e28-4c4f-b1d3-4c510fdfc863 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:18.589333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4739333-7e28-4c4f-b1d3-4c510fdfc863 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:18.589614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4739333-7e28-4c4f-b1d3-4c510fdfc863 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:18.590365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4739333-7e28-4c4f-b1d3-4c510fdfc863 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:18.591567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4739333-7e28-4c4f-b1d3-4c510fdfc863 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:18.625167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-a4739333-7e28-4c4f-b1d3-4c510fdfc863 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:18.625167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:39:18.625167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:39:18.626368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4739333-7e28-4c4f-b1d3-4c510fdfc863 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:18.640491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 191/383] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:18.646203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7344f3f-52e2-4de7-9245-50dc585dc4f4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:18.656752 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7344f3f-52e2-4de7-9245-50dc585dc4f4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:18.660963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f2e9e7-f864-4728-9c4c-732e4a5c554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:18.661754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2e9e7-f864-4728-9c4c-732e4a5c554d admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:18.662038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2e9e7-f864-4728-9c4c-732e4a5c554d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:18.662317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f2e9e7-f864-4728-9c4c-732e4a5c554d admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/394a96c082ed47bbbd645b489a4ed208/roles/021156a7816c4a96874e0a699028ceef` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:18.682191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2e9e7-f864-4728-9c4c-732e4a5c554d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=394a96c082ed47bbbd645b489a4ed208, role_id=021156a7816c4a96874e0a699028ceef)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:18.709013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f2e9e7-f864-4728-9c4c-732e4a5c554d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:18.780583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 193/384] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:39:18 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/394a96c082ed47bbbd645b489a4ed208/roles/021156a7816c4a96874e0a699028ceef => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:39:20.815545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b281cf-1310-4788-a66d-1f602e9eaf85 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:20.816111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b281cf-1310-4788-a66d-1f602e9eaf85 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:20.816111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b281cf-1310-4788-a66d-1f602e9eaf85 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:20.817813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 192/385] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:20.823529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ef4f-3f74-4a6d-85d2-8b5a5de19910 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:20.824013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ef4f-3f74-4a6d-85d2-8b5a5de19910 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:20.824586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84ef4f-3f74-4a6d-85d2-8b5a5de19910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:20.847005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7f84ef4f-3f74-4a6d-85d2-8b5a5de19910 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:20.848159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7f84ef4f-3f74-4a6d-85d2-8b5a5de19910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:20.913052 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 194/386] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:20 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:20.935433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b281cf-1310-4788-a66d-1f602e9eaf85 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:20.946977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b281cf-1310-4788-a66d-1f602e9eaf85 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:20.951449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d83c0-398f-4dca-b4e9-91b629c3fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:20.952186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d83c0-398f-4dca-b4e9-91b629c3fd91 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:20.952480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d83c0-398f-4dca-b4e9-91b629c3fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:20.952768 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d83c0-398f-4dca-b4e9-91b629c3fd91 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:20.963840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d83c0-398f-4dca-b4e9-91b629c3fd91 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:20.970921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-9f1d83c0-398f-4dca-b4e9-91b629c3fd91 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:39:20.972035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 193/387] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:20.977694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ef4f-3f74-4a6d-85d2-8b5a5de19910 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:20.986321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84ef4f-3f74-4a6d-85d2-8b5a5de19910 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:20.990316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac4d7d-9ffd-40b1-8139-3d6f88e3f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:20.990902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac4d7d-9ffd-40b1-8139-3d6f88e3f667 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:20.991187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac4d7d-9ffd-40b1-8139-3d6f88e3f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:20.991507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac4d7d-9ffd-40b1-8139-3d6f88e3f667 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:20.992212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac4d7d-9ffd-40b1-8139-3d6f88e3f667 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:20.992511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac4d7d-9ffd-40b1-8139-3d6f88e3f667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.018413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac4d7d-9ffd-40b1-8139-3d6f88e3f667 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.026707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 195/388] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:39:21.036241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d83c0-398f-4dca-b4e9-91b629c3fd91 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.046069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d83c0-398f-4dca-b4e9-91b629c3fd91 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.050031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a299b6-c806-4453-8274-bd3982374c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.050737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a299b6-c806-4453-8274-bd3982374c02 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.051023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a299b6-c806-4453-8274-bd3982374c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.051321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a299b6-c806-4453-8274-bd3982374c02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.062647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a299b6-c806-4453-8274-bd3982374c02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.088974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a299b6-c806-4453-8274-bd3982374c02 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.107546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-45a299b6-c806-4453-8274-bd3982374c02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:21.108631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 194/389] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:21.114039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac4d7d-9ffd-40b1-8139-3d6f88e3f667 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.123683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac4d7d-9ffd-40b1-8139-3d6f88e3f667 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.127606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc7d86-6db2-4e81-8878-a223996c3f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.128183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc7d86-6db2-4e81-8878-a223996c3f43 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.128497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc7d86-6db2-4e81-8878-a223996c3f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.128754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc7d86-6db2-4e81-8878-a223996c3f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.129431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc7d86-6db2-4e81-8878-a223996c3f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:21.129731 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc7d86-6db2-4e81-8878-a223996c3f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.156063 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc7d86-6db2-4e81-8878-a223996c3f43 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.168888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 196/390] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:21.174233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a299b6-c806-4453-8274-bd3982374c02 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.183447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a299b6-c806-4453-8274-bd3982374c02 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.187735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613047-a2c1-4b30-871e-9628662444f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.188443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613047-a2c1-4b30-871e-9628662444f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.188731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613047-a2c1-4b30-871e-9628662444f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.189008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46613047-a2c1-4b30-871e-9628662444f0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.202092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46613047-a2c1-4b30-871e-9628662444f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.228614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46613047-a2c1-4b30-871e-9628662444f0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.251230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-46613047-a2c1-4b30-871e-9628662444f0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 18 12:39:21.252340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 195/391] 10.222.0.87 () {56 vars in 1114 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:21.257806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc7d86-6db2-4e81-8878-a223996c3f43 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.267656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc7d86-6db2-4e81-8878-a223996c3f43 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.271642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.272228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.272520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.272807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.273595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:21.273899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.299171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:21.299171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:39:21.299171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:39:21.300355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.330336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 197/392] 10.222.0.87 () {56 vars in 1154 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:39:21.335787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613047-a2c1-4b30-871e-9628662444f0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.345120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46613047-a2c1-4b30-871e-9628662444f0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.348974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50bb10-4d4f-4cae-9c28-ecf9f75bfed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.349542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50bb10-4d4f-4cae-9c28-ecf9f75bfed5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.349834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50bb10-4d4f-4cae-9c28-ecf9f75bfed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.350113 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50bb10-4d4f-4cae-9c28-ecf9f75bfed5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.358181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50bb10-4d4f-4cae-9c28-ecf9f75bfed5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.384750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50bb10-4d4f-4cae-9c28-ecf9f75bfed5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.394067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 196/393] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:39:21.399526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.408975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e745c-3698-44aa-8802-f270d758e3ea admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.413368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66485-2d39-41fa-908d-140fdaffeeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.414080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66485-2d39-41fa-908d-140fdaffeeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.414371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66485-2d39-41fa-908d-140fdaffeeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.414658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb66485-2d39-41fa-908d-140fdaffeeb9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.426438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb66485-2d39-41fa-908d-140fdaffeeb9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.453429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb66485-2d39-41fa-908d-140fdaffeeb9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.470349 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-3eb66485-2d39-41fa-908d-140fdaffeeb9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:21.471457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 198/394] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:21.476788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50bb10-4d4f-4cae-9c28-ecf9f75bfed5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.485397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50bb10-4d4f-4cae-9c28-ecf9f75bfed5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.489320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0025-79af-4054-9a3b-c0d246f2a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.489903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0025-79af-4054-9a3b-c0d246f2a08d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.490184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0025-79af-4054-9a3b-c0d246f2a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.490463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0025-79af-4054-9a3b-c0d246f2a08d admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.491144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0025-79af-4054-9a3b-c0d246f2a08d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:21.491479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0025-79af-4054-9a3b-c0d246f2a08d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.518418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0025-79af-4054-9a3b-c0d246f2a08d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.532363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 197/395] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:21.538006 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66485-2d39-41fa-908d-140fdaffeeb9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.547990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb66485-2d39-41fa-908d-140fdaffeeb9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.551990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085cb90-fb66-448c-9d73-327be0ca949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.552694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085cb90-fb66-448c-9d73-327be0ca949d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.552984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085cb90-fb66-448c-9d73-327be0ca949d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.553265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085cb90-fb66-448c-9d73-327be0ca949d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.562076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085cb90-fb66-448c-9d73-327be0ca949d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.587617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085cb90-fb66-448c-9d73-327be0ca949d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.601449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-c085cb90-fb66-448c-9d73-327be0ca949d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:39:21.602487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 199/396] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:21.608660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0025-79af-4054-9a3b-c0d246f2a08d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.617822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0025-79af-4054-9a3b-c0d246f2a08d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.621783 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e459d9-9747-4cb3-ba97-db9488bc5847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.622391 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e459d9-9747-4cb3-ba97-db9488bc5847 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.622631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e459d9-9747-4cb3-ba97-db9488bc5847 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.622912 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e459d9-9747-4cb3-ba97-db9488bc5847 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.623683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e459d9-9747-4cb3-ba97-db9488bc5847 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:21.623985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e459d9-9747-4cb3-ba97-db9488bc5847 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.649671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e459d9-9747-4cb3-ba97-db9488bc5847 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.663624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 198/397] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:21.669948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085cb90-fb66-448c-9d73-327be0ca949d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:21.679146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085cb90-fb66-448c-9d73-327be0ca949d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:21.683033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9840f3-0f11-4ebe-badc-2598c01fda9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:21.683638 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9840f3-0f11-4ebe-badc-2598c01fda9e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:21.683929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9840f3-0f11-4ebe-badc-2598c01fda9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:21.684209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9840f3-0f11-4ebe-badc-2598c01fda9e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:21.684980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9840f3-0f11-4ebe-badc-2598c01fda9e admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=394a96c082ed47bbbd645b489a4ed208) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:21.685277 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9840f3-0f11-4ebe-badc-2598c01fda9e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:21.711386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9840f3-0f11-4ebe-badc-2598c01fda9e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:21.717744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 200/398] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:39:21 2022] GET /identity/v3/role_assignments?user.id=394a96c082ed47bbbd645b489a4ed208&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:23.806774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f72c3-8b67-41b9-a4aa-89f000659a0a None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:23.807362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f72c3-8b67-41b9-a4aa-89f000659a0a None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:23.807362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f72c3-8b67-41b9-a4aa-89f000659a0a None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:23.809551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 199/399] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:23.814842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a334beb-4b94-4bdf-b0dd-8aec1e69b01b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:23.815248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a334beb-4b94-4bdf-b0dd-8aec1e69b01b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:23.815490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a334beb-4b94-4bdf-b0dd-8aec1e69b01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:23.838802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-3a334beb-4b94-4bdf-b0dd-8aec1e69b01b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:23.839965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3a334beb-4b94-4bdf-b0dd-8aec1e69b01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:23.847714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 201/400] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:23 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:23.870310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f72c3-8b67-41b9-a4aa-89f000659a0a None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:23.882105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f72c3-8b67-41b9-a4aa-89f000659a0a None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:23.885972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26632b-1967-4559-b2a6-4ff84c339fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:23.886684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26632b-1967-4559-b2a6-4ff84c339fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:23.886972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26632b-1967-4559-b2a6-4ff84c339fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:23.887324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26632b-1967-4559-b2a6-4ff84c339fb0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:23.898519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26632b-1967-4559-b2a6-4ff84c339fb0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:23.905633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-4e26632b-1967-4559-b2a6-4ff84c339fb0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:39:23.906706 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 200/401] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:23.912483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a334beb-4b94-4bdf-b0dd-8aec1e69b01b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:23.921622 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a334beb-4b94-4bdf-b0dd-8aec1e69b01b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:23.925640 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3ec0f-20c9-404a-bcf6-a52d7ef0de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:23.926228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3ec0f-20c9-404a-bcf6-a52d7ef0de48 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:23.926516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3ec0f-20c9-404a-bcf6-a52d7ef0de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:23.926796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3ec0f-20c9-404a-bcf6-a52d7ef0de48 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:23.927525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3ec0f-20c9-404a-bcf6-a52d7ef0de48 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:23.927826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3ec0f-20c9-404a-bcf6-a52d7ef0de48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:23.953602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3ec0f-20c9-404a-bcf6-a52d7ef0de48 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:23.962446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 202/402] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:23.968920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26632b-1967-4559-b2a6-4ff84c339fb0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:23.978570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26632b-1967-4559-b2a6-4ff84c339fb0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:23.982964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3597-6057-4400-a7fa-9b7f2cf09e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:23.983715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3597-6057-4400-a7fa-9b7f2cf09e45 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:23.984006 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3597-6057-4400-a7fa-9b7f2cf09e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:23.984289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b3597-6057-4400-a7fa-9b7f2cf09e45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:23.995379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b3597-6057-4400-a7fa-9b7f2cf09e45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.022201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b3597-6057-4400-a7fa-9b7f2cf09e45 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.041261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-cc6b3597-6057-4400-a7fa-9b7f2cf09e45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:24.042350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 201/403] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:24.047972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3ec0f-20c9-404a-bcf6-a52d7ef0de48 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:24.057283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3ec0f-20c9-404a-bcf6-a52d7ef0de48 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:24.061775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02d94a-2566-4167-9fb5-9b983697ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:24.062355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02d94a-2566-4167-9fb5-9b983697ac79 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:24.062647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02d94a-2566-4167-9fb5-9b983697ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:24.062931 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02d94a-2566-4167-9fb5-9b983697ac79 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:24.063645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02d94a-2566-4167-9fb5-9b983697ac79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:24.063949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02d94a-2566-4167-9fb5-9b983697ac79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.089563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02d94a-2566-4167-9fb5-9b983697ac79 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.104576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 203/404] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:24.110050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3597-6057-4400-a7fa-9b7f2cf09e45 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:24.119377 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b3597-6057-4400-a7fa-9b7f2cf09e45 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:24.123583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a9b1-9380-4c84-9342-003598ca6b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:24.124290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a9b1-9380-4c84-9342-003598ca6b7b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:24.124576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a9b1-9380-4c84-9342-003598ca6b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:24.124856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186a9b1-9380-4c84-9342-003598ca6b7b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:24.137691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186a9b1-9380-4c84-9342-003598ca6b7b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.164501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186a9b1-9380-4c84-9342-003598ca6b7b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.181921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-9186a9b1-9380-4c84-9342-003598ca6b7b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 18 12:39:24.182999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 202/405] 10.222.0.87 () {56 vars in 1114 bytes} [Tue Jan 18 12:39:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:39:24.188478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02d94a-2566-4167-9fb5-9b983697ac79 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:24.197674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02d94a-2566-4167-9fb5-9b983697ac79 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:24.202385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cf3e2-f884-414e-8f3c-7f5321476cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:24.202967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cf3e2-f884-414e-8f3c-7f5321476cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:24.203251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cf3e2-f884-414e-8f3c-7f5321476cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:24.203558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cf3e2-f884-414e-8f3c-7f5321476cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:24.204327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cf3e2-f884-414e-8f3c-7f5321476cc7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:24.204623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cf3e2-f884-414e-8f3c-7f5321476cc7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.234450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8cf3e2-f884-414e-8f3c-7f5321476cc7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.264070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 204/406] 10.222.0.87 () {56 vars in 1154 bytes} [Tue Jan 18 12:39:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:24.269548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a9b1-9380-4c84-9342-003598ca6b7b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:24.279669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186a9b1-9380-4c84-9342-003598ca6b7b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:24.283562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1a7b7-88e2-4f7c-acf2-04b34a3863e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:24.284130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1a7b7-88e2-4f7c-acf2-04b34a3863e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:24.284668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1a7b7-88e2-4f7c-acf2-04b34a3863e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:24.284945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1a7b7-88e2-4f7c-acf2-04b34a3863e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:24.292625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1a7b7-88e2-4f7c-acf2-04b34a3863e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.319162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1a7b7-88e2-4f7c-acf2-04b34a3863e0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.328662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 203/407] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:39:24 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:39:24.334326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cf3e2-f884-414e-8f3c-7f5321476cc7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:24.344044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8cf3e2-f884-414e-8f3c-7f5321476cc7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:24.348055 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0811e-3472-4be1-ad79-608c91fe8c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:24.348755 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0811e-3472-4be1-ad79-608c91fe8c98 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:24.349046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0811e-3472-4be1-ad79-608c91fe8c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:24.349330 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0811e-3472-4be1-ad79-608c91fe8c98 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:24.361136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0811e-3472-4be1-ad79-608c91fe8c98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.394465 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0811e-3472-4be1-ad79-608c91fe8c98 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.412861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-02b0811e-3472-4be1-ad79-608c91fe8c98 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:24.413980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 205/408] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:24.419637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1a7b7-88e2-4f7c-acf2-04b34a3863e0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:24.428128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1a7b7-88e2-4f7c-acf2-04b34a3863e0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:24.432161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4324cf2-e3d9-4d93-b8e8-24954fb01b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:24.432743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4324cf2-e3d9-4d93-b8e8-24954fb01b87 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:24.433029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4324cf2-e3d9-4d93-b8e8-24954fb01b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:24.433308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4324cf2-e3d9-4d93-b8e8-24954fb01b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:24.434500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4324cf2-e3d9-4d93-b8e8-24954fb01b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:24.434800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4324cf2-e3d9-4d93-b8e8-24954fb01b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.460676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4324cf2-e3d9-4d93-b8e8-24954fb01b87 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.473830 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 204/409] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:24.479194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0811e-3472-4be1-ad79-608c91fe8c98 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:24.488539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0811e-3472-4be1-ad79-608c91fe8c98 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:24.492410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb25e1-0059-4d63-9703-4902b2f6baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:24.493107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb25e1-0059-4d63-9703-4902b2f6baa9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:24.493390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb25e1-0059-4d63-9703-4902b2f6baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:24.493664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb25e1-0059-4d63-9703-4902b2f6baa9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:24.503393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb25e1-0059-4d63-9703-4902b2f6baa9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.529507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb25e1-0059-4d63-9703-4902b2f6baa9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.543887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-80fb25e1-0059-4d63-9703-4902b2f6baa9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:39:24.544999 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 206/410] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:24.550575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4324cf2-e3d9-4d93-b8e8-24954fb01b87 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:24.560553 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4324cf2-e3d9-4d93-b8e8-24954fb01b87 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:24.564509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e69397-c8be-4401-bea4-34146b7bc79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:24.565087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e69397-c8be-4401-bea4-34146b7bc79d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:24.565373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e69397-c8be-4401-bea4-34146b7bc79d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:24.565656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e69397-c8be-4401-bea4-34146b7bc79d admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:24.566393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e69397-c8be-4401-bea4-34146b7bc79d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:24.566694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e69397-c8be-4401-bea4-34146b7bc79d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.598055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e69397-c8be-4401-bea4-34146b7bc79d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.612846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 205/411] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:24.618665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb25e1-0059-4d63-9703-4902b2f6baa9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:24.628615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb25e1-0059-4d63-9703-4902b2f6baa9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:24.632587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea875af2-96a2-4ec1-b1db-c144158d0e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:24.633160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea875af2-96a2-4ec1-b1db-c144158d0e0f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:24.633447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea875af2-96a2-4ec1-b1db-c144158d0e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:24.633730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea875af2-96a2-4ec1-b1db-c144158d0e0f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:24.634495 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea875af2-96a2-4ec1-b1db-c144158d0e0f admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=394a96c082ed47bbbd645b489a4ed208) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:24.634802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea875af2-96a2-4ec1-b1db-c144158d0e0f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:24.662584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea875af2-96a2-4ec1-b1db-c144158d0e0f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:24.668018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 207/412] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:39:24 2022] GET /identity/v3/role_assignments?user.id=394a96c082ed47bbbd645b489a4ed208&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:26.608653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624005b-d354-4ec2-b513-ed69eb357e36 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:26.609203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624005b-d354-4ec2-b513-ed69eb357e36 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:26.609203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624005b-d354-4ec2-b513-ed69eb357e36 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:26.610875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 206/413] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:26.616061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d75778-b32f-4755-a5b2-51bdf83feaaa None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:26.616459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d75778-b32f-4755-a5b2-51bdf83feaaa None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:26.616616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d75778-b32f-4755-a5b2-51bdf83feaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:26.640159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-92d75778-b32f-4755-a5b2-51bdf83feaaa None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:26.641268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-92d75778-b32f-4755-a5b2-51bdf83feaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:26.647830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 208/414] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:26 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:26.669701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624005b-d354-4ec2-b513-ed69eb357e36 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:26.682052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624005b-d354-4ec2-b513-ed69eb357e36 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:26.686829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e82e95-c611-4e2c-b2c8-e0b5fca551a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:26.687595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e82e95-c611-4e2c-b2c8-e0b5fca551a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:26.687893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e82e95-c611-4e2c-b2c8-e0b5fca551a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:26.688174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e82e95-c611-4e2c-b2c8-e0b5fca551a3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:26.699193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e82e95-c611-4e2c-b2c8-e0b5fca551a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:26.706493 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-f2e82e95-c611-4e2c-b2c8-e0b5fca551a3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:39:26.707605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 207/415] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:39:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:26.713373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d75778-b32f-4755-a5b2-51bdf83feaaa None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:26.722100 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d75778-b32f-4755-a5b2-51bdf83feaaa None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:26.726108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68aec47-30d9-4828-84e2-67c9a55f9b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:26.726693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68aec47-30d9-4828-84e2-67c9a55f9b8f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:26.726980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68aec47-30d9-4828-84e2-67c9a55f9b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:26.727261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68aec47-30d9-4828-84e2-67c9a55f9b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:26.727991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68aec47-30d9-4828-84e2-67c9a55f9b8f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:26.728290 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68aec47-30d9-4828-84e2-67c9a55f9b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:26.754366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68aec47-30d9-4828-84e2-67c9a55f9b8f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:26.763826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 209/416] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:26.769163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e82e95-c611-4e2c-b2c8-e0b5fca551a3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:26.779380 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e82e95-c611-4e2c-b2c8-e0b5fca551a3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:26.783295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71ee28-2bd4-448a-87fd-18421f9fb384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:26.784016 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71ee28-2bd4-448a-87fd-18421f9fb384 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:26.784569 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71ee28-2bd4-448a-87fd-18421f9fb384 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:26.784851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71ee28-2bd4-448a-87fd-18421f9fb384 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:26.796102 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71ee28-2bd4-448a-87fd-18421f9fb384 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:26.821944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71ee28-2bd4-448a-87fd-18421f9fb384 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:26.839774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-1e71ee28-2bd4-448a-87fd-18421f9fb384 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:26.840882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 208/417] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:26.846590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68aec47-30d9-4828-84e2-67c9a55f9b8f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:26.855836 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68aec47-30d9-4828-84e2-67c9a55f9b8f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:26.859810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8def30-8400-4b1a-b59c-f42f3802b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:26.860327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8def30-8400-4b1a-b59c-f42f3802b54b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:26.860611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8def30-8400-4b1a-b59c-f42f3802b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:26.860889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8def30-8400-4b1a-b59c-f42f3802b54b admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:26.861561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8def30-8400-4b1a-b59c-f42f3802b54b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:26.861855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8def30-8400-4b1a-b59c-f42f3802b54b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:26.888281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8def30-8400-4b1a-b59c-f42f3802b54b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:26.900701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 210/418] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:26.906197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71ee28-2bd4-448a-87fd-18421f9fb384 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:26.918845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71ee28-2bd4-448a-87fd-18421f9fb384 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:26.931943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764910b-9e10-4e53-8707-1ea914862e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:26.932722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764910b-9e10-4e53-8707-1ea914862e7c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:26.933083 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764910b-9e10-4e53-8707-1ea914862e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:26.933411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764910b-9e10-4e53-8707-1ea914862e7c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:26.947193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764910b-9e10-4e53-8707-1ea914862e7c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:26.974463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764910b-9e10-4e53-8707-1ea914862e7c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:26.992924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b764910b-9e10-4e53-8707-1ea914862e7c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 18 12:39:26.994015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 209/419] 10.222.0.87 () {56 vars in 1114 bytes} [Tue Jan 18 12:39:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:27.000480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8def30-8400-4b1a-b59c-f42f3802b54b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:27.009802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8def30-8400-4b1a-b59c-f42f3802b54b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:27.014219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f7614-ce63-4c9a-91d6-6c9fde6cdb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:27.014802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f7614-ce63-4c9a-91d6-6c9fde6cdb2a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:27.015094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f7614-ce63-4c9a-91d6-6c9fde6cdb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:27.015410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f7614-ce63-4c9a-91d6-6c9fde6cdb2a admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:27.016185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f7614-ce63-4c9a-91d6-6c9fde6cdb2a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:27.016487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f7614-ce63-4c9a-91d6-6c9fde6cdb2a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:27.042212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f7614-ce63-4c9a-91d6-6c9fde6cdb2a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:27.071628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 211/420] 10.222.0.87 () {56 vars in 1154 bytes} [Tue Jan 18 12:39:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:27.077370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764910b-9e10-4e53-8707-1ea914862e7c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:27.086774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764910b-9e10-4e53-8707-1ea914862e7c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:27.090699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef05911-7f01-47b4-b21e-336b3b6790af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:27.091442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef05911-7f01-47b4-b21e-336b3b6790af admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:27.091729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef05911-7f01-47b4-b21e-336b3b6790af admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:27.092006 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef05911-7f01-47b4-b21e-336b3b6790af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:27.103956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef05911-7f01-47b4-b21e-336b3b6790af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:27.130632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef05911-7f01-47b4-b21e-336b3b6790af admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:27.147072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-2ef05911-7f01-47b4-b21e-336b3b6790af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:27.148150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 210/421] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:27.154042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f7614-ce63-4c9a-91d6-6c9fde6cdb2a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:27.163545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f7614-ce63-4c9a-91d6-6c9fde6cdb2a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:27.167539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096d5d-6238-4f75-b386-16e89cea76b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:27.168643 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096d5d-6238-4f75-b386-16e89cea76b5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:27.169386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096d5d-6238-4f75-b386-16e89cea76b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:27.169679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f096d5d-6238-4f75-b386-16e89cea76b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:27.170365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096d5d-6238-4f75-b386-16e89cea76b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:27.170670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096d5d-6238-4f75-b386-16e89cea76b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:27.197060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f096d5d-6238-4f75-b386-16e89cea76b5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:27.209932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 212/422] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:27.215463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef05911-7f01-47b4-b21e-336b3b6790af admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:27.224701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef05911-7f01-47b4-b21e-336b3b6790af admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:27.228568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50917af-f760-4b55-a5e8-3af60f7762c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:27.229268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50917af-f760-4b55-a5e8-3af60f7762c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:27.229549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50917af-f760-4b55-a5e8-3af60f7762c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:27.229824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50917af-f760-4b55-a5e8-3af60f7762c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:27.239270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50917af-f760-4b55-a5e8-3af60f7762c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:27.266851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50917af-f760-4b55-a5e8-3af60f7762c9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:27.282690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b50917af-f760-4b55-a5e8-3af60f7762c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:39:27.283995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 211/423] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:27.290034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096d5d-6238-4f75-b386-16e89cea76b5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:27.300027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f096d5d-6238-4f75-b386-16e89cea76b5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:27.304007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3335d06-d152-49f9-8273-88ea2ba7b231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:27.304764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3335d06-d152-49f9-8273-88ea2ba7b231 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:27.305075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3335d06-d152-49f9-8273-88ea2ba7b231 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:27.305347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3335d06-d152-49f9-8273-88ea2ba7b231 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:27.306082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3335d06-d152-49f9-8273-88ea2ba7b231 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:27.306386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3335d06-d152-49f9-8273-88ea2ba7b231 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:27.333190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3335d06-d152-49f9-8273-88ea2ba7b231 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:27.346839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 213/424] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:27.352558 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50917af-f760-4b55-a5e8-3af60f7762c9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:27.362484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50917af-f760-4b55-a5e8-3af60f7762c9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:27.366533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544039d-a55f-4617-b8da-e310638a3541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:27.367351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544039d-a55f-4617-b8da-e310638a3541 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:27.367642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544039d-a55f-4617-b8da-e310638a3541 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:27.367922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544039d-a55f-4617-b8da-e310638a3541 admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/394a96c082ed47bbbd645b489a4ed208/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:27.369757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544039d-a55f-4617-b8da-e310638a3541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=394a96c082ed47bbbd645b489a4ed208, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:27.396322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1544039d-a55f-4617-b8da-e310638a3541 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:27.467934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 212/425] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:39:27 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/394a96c082ed47bbbd645b489a4ed208/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:39:29.456708 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe06f2-9f4e-4fb4-a790-419e74c28dfe None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:29.457203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe06f2-9f4e-4fb4-a790-419e74c28dfe None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:29.457203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe06f2-9f4e-4fb4-a790-419e74c28dfe None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:29.458891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 214/426] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:29.464002 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a01ae-a679-4f8c-806a-142ae883fa4d None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:29.464400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a01ae-a679-4f8c-806a-142ae883fa4d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:29.464557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a01ae-a679-4f8c-806a-142ae883fa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:29.487278 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-201a01ae-a679-4f8c-806a-142ae883fa4d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:29.488428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-201a01ae-a679-4f8c-806a-142ae883fa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:29.551502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 213/427] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:29 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:29.573949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe06f2-9f4e-4fb4-a790-419e74c28dfe None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:29.585620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe06f2-9f4e-4fb4-a790-419e74c28dfe None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:29.589484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b6116-7e2b-48ec-a2fc-f4eb97226be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:29.590977 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b6116-7e2b-48ec-a2fc-f4eb97226be5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:29.591366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b6116-7e2b-48ec-a2fc-f4eb97226be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:29.591667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b6116-7e2b-48ec-a2fc-f4eb97226be5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:29.602457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90b6116-7e2b-48ec-a2fc-f4eb97226be5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:29.609567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-f90b6116-7e2b-48ec-a2fc-f4eb97226be5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:39:29.610628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 215/428] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:29.616173 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a01ae-a679-4f8c-806a-142ae883fa4d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:29.624822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a01ae-a679-4f8c-806a-142ae883fa4d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:29.628843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86aa8-38af-47f8-be83-85e4e2230fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:29.629425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86aa8-38af-47f8-be83-85e4e2230fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:29.629708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86aa8-38af-47f8-be83-85e4e2230fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:29.629989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f86aa8-38af-47f8-be83-85e4e2230fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:29.630693 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86aa8-38af-47f8-be83-85e4e2230fc5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:29.630986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86aa8-38af-47f8-be83-85e4e2230fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:29.657371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f86aa8-38af-47f8-be83-85e4e2230fc5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:29.666602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 214/429] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:39:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:29.673302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b6116-7e2b-48ec-a2fc-f4eb97226be5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:29.683009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b6116-7e2b-48ec-a2fc-f4eb97226be5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:29.687537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031869-dff5-438c-8046-b9510ed0f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:29.688248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031869-dff5-438c-8046-b9510ed0f3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:29.688537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031869-dff5-438c-8046-b9510ed0f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:29.688828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11031869-dff5-438c-8046-b9510ed0f3d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:29.700423 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11031869-dff5-438c-8046-b9510ed0f3d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:29.726749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11031869-dff5-438c-8046-b9510ed0f3d1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:29.744939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-11031869-dff5-438c-8046-b9510ed0f3d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:29.746002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 216/430] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:29.751627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86aa8-38af-47f8-be83-85e4e2230fc5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:29.760754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f86aa8-38af-47f8-be83-85e4e2230fc5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:29.764849 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa30bd-6e4e-44c0-87a5-51c38dd2afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:29.765425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa30bd-6e4e-44c0-87a5-51c38dd2afcd admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:29.765707 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa30bd-6e4e-44c0-87a5-51c38dd2afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:29.765983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa30bd-6e4e-44c0-87a5-51c38dd2afcd admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:29.766659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa30bd-6e4e-44c0-87a5-51c38dd2afcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:29.766953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa30bd-6e4e-44c0-87a5-51c38dd2afcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:29.794409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa30bd-6e4e-44c0-87a5-51c38dd2afcd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:29.807274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 215/431] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:29.812718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031869-dff5-438c-8046-b9510ed0f3d1 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:29.821847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11031869-dff5-438c-8046-b9510ed0f3d1 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:29.825833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8633a-edc7-4423-b01a-be6d9c24635d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:29.826535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8633a-edc7-4423-b01a-be6d9c24635d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:29.826823 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8633a-edc7-4423-b01a-be6d9c24635d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:29.827105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8633a-edc7-4423-b01a-be6d9c24635d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:29.841619 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8633a-edc7-4423-b01a-be6d9c24635d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:29.867781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8633a-edc7-4423-b01a-be6d9c24635d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:29.885295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-c6d8633a-edc7-4423-b01a-be6d9c24635d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 18 12:39:29.886356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 217/432] 10.222.0.87 () {56 vars in 1114 bytes} [Tue Jan 18 12:39:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:29.891954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa30bd-6e4e-44c0-87a5-51c38dd2afcd admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:29.901145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa30bd-6e4e-44c0-87a5-51c38dd2afcd admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:29.906079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d030d-a832-48e6-b2c2-6713e05877f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:29.906669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d030d-a832-48e6-b2c2-6713e05877f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:29.906957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d030d-a832-48e6-b2c2-6713e05877f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:29.907240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d030d-a832-48e6-b2c2-6713e05877f3 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:29.908089 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d030d-a832-48e6-b2c2-6713e05877f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:29.908399 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d030d-a832-48e6-b2c2-6713e05877f3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:29.935355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d030d-a832-48e6-b2c2-6713e05877f3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:29.964357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 216/433] 10.222.0.87 () {56 vars in 1154 bytes} [Tue Jan 18 12:39:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:39:29.970291 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8633a-edc7-4423-b01a-be6d9c24635d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:29.979480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8633a-edc7-4423-b01a-be6d9c24635d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:29.983659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b821a49-ce39-4ee5-b4da-385136a184cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:29.984225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b821a49-ce39-4ee5-b4da-385136a184cd admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:29.984511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b821a49-ce39-4ee5-b4da-385136a184cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:29.984791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b821a49-ce39-4ee5-b4da-385136a184cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:29.992342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b821a49-ce39-4ee5-b4da-385136a184cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:30.018334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b821a49-ce39-4ee5-b4da-385136a184cd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:30.027005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 218/434] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:39:29 2022] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:39:30.033084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d030d-a832-48e6-b2c2-6713e05877f3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:30.042402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d030d-a832-48e6-b2c2-6713e05877f3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:30.046756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aabd2c-fce8-4b21-aad3-80718ed50bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:30.047505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aabd2c-fce8-4b21-aad3-80718ed50bce admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:30.047788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aabd2c-fce8-4b21-aad3-80718ed50bce admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:30.048067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aabd2c-fce8-4b21-aad3-80718ed50bce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:30.061132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aabd2c-fce8-4b21-aad3-80718ed50bce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:30.087136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aabd2c-fce8-4b21-aad3-80718ed50bce admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:30.104928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-78aabd2c-fce8-4b21-aad3-80718ed50bce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:30.106065 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 217/435] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:30.111399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b821a49-ce39-4ee5-b4da-385136a184cd admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:30.119869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b821a49-ce39-4ee5-b4da-385136a184cd admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:30.124487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ca01-0bb4-4bd8-8fe6-d9cf48857ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:30.125067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ca01-0bb4-4bd8-8fe6-d9cf48857ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:30.125356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ca01-0bb4-4bd8-8fe6-d9cf48857ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:30.125638 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ca01-0bb4-4bd8-8fe6-d9cf48857ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:30.126315 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ca01-0bb4-4bd8-8fe6-d9cf48857ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:30.126615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ca01-0bb4-4bd8-8fe6-d9cf48857ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:30.157783 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ca01-0bb4-4bd8-8fe6-d9cf48857ce7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:30.171761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 219/436] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:30.177212 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aabd2c-fce8-4b21-aad3-80718ed50bce admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:30.186580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aabd2c-fce8-4b21-aad3-80718ed50bce admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:30.190477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff53edb-fc5e-46c4-926b-e7e11205936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:30.191192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff53edb-fc5e-46c4-926b-e7e11205936c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:30.191518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff53edb-fc5e-46c4-926b-e7e11205936c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:30.191801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff53edb-fc5e-46c4-926b-e7e11205936c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:30.201342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff53edb-fc5e-46c4-926b-e7e11205936c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:30.226882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff53edb-fc5e-46c4-926b-e7e11205936c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:30.240803 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-0ff53edb-fc5e-46c4-926b-e7e11205936c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:39:30.241802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 218/437] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:30.247968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ca01-0bb4-4bd8-8fe6-d9cf48857ce7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:30.257217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ca01-0bb4-4bd8-8fe6-d9cf48857ce7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:30.261474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514e683-8924-4ac9-b301-f92e96e241f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:30.262126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e683-8924-4ac9-b301-f92e96e241f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:30.262410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e683-8924-4ac9-b301-f92e96e241f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:30.262685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514e683-8924-4ac9-b301-f92e96e241f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:30.263462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e683-8924-4ac9-b301-f92e96e241f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:30.263765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e683-8924-4ac9-b301-f92e96e241f3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:30.289585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514e683-8924-4ac9-b301-f92e96e241f3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:30.303125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 220/438] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:30.309265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff53edb-fc5e-46c4-926b-e7e11205936c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:30.318555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff53edb-fc5e-46c4-926b-e7e11205936c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:30.322509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b86d5-8c21-451b-8e1d-115a3829ed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:30.323082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b86d5-8c21-451b-8e1d-115a3829ed72 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:30.323447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b86d5-8c21-451b-8e1d-115a3829ed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:30.323727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b86d5-8c21-451b-8e1d-115a3829ed72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:30.324503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b86d5-8c21-451b-8e1d-115a3829ed72 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=394a96c082ed47bbbd645b489a4ed208) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:30.324801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b86d5-8c21-451b-8e1d-115a3829ed72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:30.351072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b86d5-8c21-451b-8e1d-115a3829ed72 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:30.357636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 219/439] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:39:30 2022] GET /identity/v3/role_assignments?user.id=394a96c082ed47bbbd645b489a4ed208&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:32.383089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd327d-144b-450f-8413-2f5ada8470c5 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:32.383727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd327d-144b-450f-8413-2f5ada8470c5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:32.383727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd327d-144b-450f-8413-2f5ada8470c5 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:32.385350 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 221/440] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:32.391211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f5bd2-5525-43ec-96d7-9b6c861574b8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:32.391669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f5bd2-5525-43ec-96d7-9b6c861574b8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:32.391811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f5bd2-5525-43ec-96d7-9b6c861574b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:32.414713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1f7f5bd2-5525-43ec-96d7-9b6c861574b8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:32.415864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1f7f5bd2-5525-43ec-96d7-9b6c861574b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:32.422628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 220/441] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:32 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:32.443682 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd327d-144b-450f-8413-2f5ada8470c5 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:32.455877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd327d-144b-450f-8413-2f5ada8470c5 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:32.459700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:32.460417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:32.460703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:32.460979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:32.461589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:32.486888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:32.486888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:39:32.486888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:39:32.487794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:32.499222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 18 12:39:32.500334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 222/442] 10.222.0.87 () {56 vars in 1153 bytes} [Tue Jan 18 12:39:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:32.506456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f5bd2-5525-43ec-96d7-9b6c861574b8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:32.520169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f5bd2-5525-43ec-96d7-9b6c861574b8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:32.526966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8abfe1-8c13-45c9-8431-19d1b7076492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:32.527795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8abfe1-8c13-45c9-8431-19d1b7076492 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:32.528086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8abfe1-8c13-45c9-8431-19d1b7076492 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:32.528368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8abfe1-8c13-45c9-8431-19d1b7076492 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:32.529090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8abfe1-8c13-45c9-8431-19d1b7076492 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:32.531110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8abfe1-8c13-45c9-8431-19d1b7076492 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:32.570059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-0d8abfe1-8c13-45c9-8431-19d1b7076492 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:32.570059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:39:32.570059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:39:32.570945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8abfe1-8c13-45c9-8431-19d1b7076492 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:32.576595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 221/443] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:39:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:32.582324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:32.591832 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1ce6c-cbcf-4c02-b7e3-7d8b07298fdd admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:32.595706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74759c5-30db-4d4d-a06f-cf9bbd2586e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:32.596274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74759c5-30db-4d4d-a06f-cf9bbd2586e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:32.596558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74759c5-30db-4d4d-a06f-cf9bbd2586e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:32.596835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74759c5-30db-4d4d-a06f-cf9bbd2586e2 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:32.597490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74759c5-30db-4d4d-a06f-cf9bbd2586e2 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:32.597785 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74759c5-30db-4d4d-a06f-cf9bbd2586e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:32.624658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-d74759c5-30db-4d4d-a06f-cf9bbd2586e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:32.624658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:39:32.624658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:39:32.625517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74759c5-30db-4d4d-a06f-cf9bbd2586e2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:32.630095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 223/444] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:39:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:34.590301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3edb33-0d4f-45ce-b395-4bbc45ecc502 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:34.590825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3edb33-0d4f-45ce-b395-4bbc45ecc502 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:34.590908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3edb33-0d4f-45ce-b395-4bbc45ecc502 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:34.592592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 222/445] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:34.598494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5318524-8a9a-4584-b8de-cf4558c0b256 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:34.598944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5318524-8a9a-4584-b8de-cf4558c0b256 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:34.599058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5318524-8a9a-4584-b8de-cf4558c0b256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:34.625522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c5318524-8a9a-4584-b8de-cf4558c0b256 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:34.626685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c5318524-8a9a-4584-b8de-cf4558c0b256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:34.633371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 224/446] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:34 2022] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:34.656932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3edb33-0d4f-45ce-b395-4bbc45ecc502 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:34.669940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3edb33-0d4f-45ce-b395-4bbc45ecc502 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:34.673742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f003a-e680-4308-9f57-60489f1854b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:34.674429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f003a-e680-4308-9f57-60489f1854b7 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:34.674714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f003a-e680-4308-9f57-60489f1854b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:34.674993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f003a-e680-4308-9f57-60489f1854b7 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:34.675705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f003a-e680-4308-9f57-60489f1854b7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:34.701108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-228f003a-e680-4308-9f57-60489f1854b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:34.701108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:39:34.701108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:39:34.701970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f003a-e680-4308-9f57-60489f1854b7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:34.791159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 223/447] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:39:34 2022] POST /identity/v3/services => generated 269 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:39:36.769861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47627ee6-70c0-4a8d-9830-e5449a37c6cd None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:36.770386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47627ee6-70c0-4a8d-9830-e5449a37c6cd None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:36.770472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47627ee6-70c0-4a8d-9830-e5449a37c6cd None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:36.772187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 225/448] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:36.777574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ae32c-7428-4258-bf24-b4f0302bec6e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:36.777987 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ae32c-7428-4258-bf24-b4f0302bec6e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:36.778143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ae32c-7428-4258-bf24-b4f0302bec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:36.800959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b14ae32c-7428-4258-bf24-b4f0302bec6e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:36.802139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b14ae32c-7428-4258-bf24-b4f0302bec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:36.818498 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 224/449] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:36 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:36.840512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47627ee6-70c0-4a8d-9830-e5449a37c6cd None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:36.851916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47627ee6-70c0-4a8d-9830-e5449a37c6cd None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:36.856294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc3e31-1c89-4de6-9687-5a68d89a4df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:36.857009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc3e31-1c89-4de6-9687-5a68d89a4df2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:36.857294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc3e31-1c89-4de6-9687-5a68d89a4df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:36.857572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc3e31-1c89-4de6-9687-5a68d89a4df2 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:36.858184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc3e31-1c89-4de6-9687-5a68d89a4df2 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:36.883978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc3e31-1c89-4de6-9687-5a68d89a4df2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:36.894479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-32bc3e31-1c89-4de6-9687-5a68d89a4df2 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 18 12:39:36.895539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 226/450] 10.222.0.87 () {56 vars in 1153 bytes} [Tue Jan 18 12:39:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:36.901235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ae32c-7428-4258-bf24-b4f0302bec6e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:36.910070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ae32c-7428-4258-bf24-b4f0302bec6e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:36.914112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1bc32-2fbf-4bc3-b31d-e48ccf7ce69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:36.914699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1bc32-2fbf-4bc3-b31d-e48ccf7ce69b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:36.914988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1bc32-2fbf-4bc3-b31d-e48ccf7ce69b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:36.915276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1bc32-2fbf-4bc3-b31d-e48ccf7ce69b admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:36.915972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1bc32-2fbf-4bc3-b31d-e48ccf7ce69b admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:36.916277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1bc32-2fbf-4bc3-b31d-e48ccf7ce69b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:36.942973 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1bc32-2fbf-4bc3-b31d-e48ccf7ce69b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:36.947555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 225/451] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:39:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:36.953064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc3e31-1c89-4de6-9687-5a68d89a4df2 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:36.962142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc3e31-1c89-4de6-9687-5a68d89a4df2 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:36.966212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ee22-accd-42bb-910e-c80d642917f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:36.966779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ee22-accd-42bb-910e-c80d642917f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:36.967066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ee22-accd-42bb-910e-c80d642917f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:36.967373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3978ee22-accd-42bb-910e-c80d642917f0 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:36.968030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978ee22-accd-42bb-910e-c80d642917f0 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:36.968325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978ee22-accd-42bb-910e-c80d642917f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:36.994395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3978ee22-accd-42bb-910e-c80d642917f0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:36.999133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 227/452] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:39:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:37.004617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1bc32-2fbf-4bc3-b31d-e48ccf7ce69b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:37.014565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1bc32-2fbf-4bc3-b31d-e48ccf7ce69b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:37.018551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642df68d-04fa-461e-bac6-2128d0706a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:37.019126 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df68d-04fa-461e-bac6-2128d0706a05 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:37.019457 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df68d-04fa-461e-bac6-2128d0706a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:37.019743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642df68d-04fa-461e-bac6-2128d0706a05 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:37.020530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642df68d-04fa-461e-bac6-2128d0706a05 admin admin] RBAC: Adding query filter params (interface=public, service_id=bd2a002b4c914e87973b2d175846a530, region_id=RegionOne) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:37.020789 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642df68d-04fa-461e-bac6-2128d0706a05 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:37.046936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-642df68d-04fa-461e-bac6-2128d0706a05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:37.046936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:39:37.046936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:39:37.047835 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642df68d-04fa-461e-bac6-2128d0706a05 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:37.053825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 226/453] 10.222.0.87 () {56 vars in 1272 bytes} [Tue Jan 18 12:39:37 2022] GET /identity/v3/endpoints?service_id=bd2a002b4c914e87973b2d175846a530&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:37.059082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ee22-accd-42bb-910e-c80d642917f0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:37.069259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3978ee22-accd-42bb-910e-c80d642917f0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:37.073211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbcd4e0-2e14-4689-ad2b-b43a87afa811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:37.073922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcd4e0-2e14-4689-ad2b-b43a87afa811 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:37.074292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcd4e0-2e14-4689-ad2b-b43a87afa811 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:37.074578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbcd4e0-2e14-4689-ad2b-b43a87afa811 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:37.075225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcd4e0-2e14-4689-ad2b-b43a87afa811 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:37.101416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbcd4e0-2e14-4689-ad2b-b43a87afa811 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:37.107200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 228/454] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:39:37 2022] GET /identity/v3/services => generated 562 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:39.093103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d0d8b-2336-4a30-b990-89209f915f4c None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:39.093523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d0d8b-2336-4a30-b990-89209f915f4c None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:39.093667 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d0d8b-2336-4a30-b990-89209f915f4c None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:39.095506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 227/455] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:39.100626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3a158-9169-426b-bda4-dd937e0b7eed None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:39.101030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3a158-9169-426b-bda4-dd937e0b7eed None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:39.101188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3a158-9169-426b-bda4-dd937e0b7eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:39.124402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-60b3a158-9169-426b-bda4-dd937e0b7eed None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:39.125845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-60b3a158-9169-426b-bda4-dd937e0b7eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:39.132227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 229/456] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:39 2022] POST /identity/v3/auth/tokens => generated 1177 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:39.154574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d0d8b-2336-4a30-b990-89209f915f4c None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:39.166410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d0d8b-2336-4a30-b990-89209f915f4c None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:39.170967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:39.171720 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:39.172009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:39.172290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:39.172910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:39.203631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:39.203631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:39:39.203631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:39:39.204505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:39.216667 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 18 12:39:39.217753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 228/457] 10.222.0.87 () {56 vars in 1153 bytes} [Tue Jan 18 12:39:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:39.223739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3a158-9169-426b-bda4-dd937e0b7eed None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:39.233453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3a158-9169-426b-bda4-dd937e0b7eed None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:39.237484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca873aa0-579b-4891-b8e3-04d1fcb6c209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:39.238064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca873aa0-579b-4891-b8e3-04d1fcb6c209 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:39.238355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca873aa0-579b-4891-b8e3-04d1fcb6c209 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:39.238637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca873aa0-579b-4891-b8e3-04d1fcb6c209 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:39.239300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca873aa0-579b-4891-b8e3-04d1fcb6c209 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:39.239637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca873aa0-579b-4891-b8e3-04d1fcb6c209 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:39.266557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca873aa0-579b-4891-b8e3-04d1fcb6c209 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:39.270896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 230/458] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:39:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:39.276623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:39.286203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa855b8-7e4a-4a6f-9712-d2ec3f24c9cd admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:39.290174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7196-60f0-4ea8-8274-3419d59552cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:39.290755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7196-60f0-4ea8-8274-3419d59552cb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:39.291044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7196-60f0-4ea8-8274-3419d59552cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:39.291347 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7196-60f0-4ea8-8274-3419d59552cb admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:39.292019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7196-60f0-4ea8-8274-3419d59552cb admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:39.292318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7196-60f0-4ea8-8274-3419d59552cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:39.318222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7196-60f0-4ea8-8274-3419d59552cb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:39.322984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 229/459] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:39:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:39.328523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca873aa0-579b-4891-b8e3-04d1fcb6c209 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:39.337750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca873aa0-579b-4891-b8e3-04d1fcb6c209 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:39.342672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf5c45-58ea-45ac-88d2-e47a3fcba814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:39.343250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf5c45-58ea-45ac-88d2-e47a3fcba814 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:39.343569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf5c45-58ea-45ac-88d2-e47a3fcba814 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:39.343853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf5c45-58ea-45ac-88d2-e47a3fcba814 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:39.344542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf5c45-58ea-45ac-88d2-e47a3fcba814 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:39.370133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-debf5c45-58ea-45ac-88d2-e47a3fcba814 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:39.370133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:39:39.370133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:39:39.371586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf5c45-58ea-45ac-88d2-e47a3fcba814 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:39.512128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 231/460] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:39:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:39:41.540947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827824d-4225-41fc-a0a6-118419d2e9aa None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:41.541516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827824d-4225-41fc-a0a6-118419d2e9aa None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:41.541516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827824d-4225-41fc-a0a6-118419d2e9aa None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:41.543423 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 230/461] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:41.548401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6529b-189a-48e0-8a51-a2370fbc888a None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:41.548788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6529b-189a-48e0-8a51-a2370fbc888a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:41.548972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6529b-189a-48e0-8a51-a2370fbc888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:41.571492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a1f6529b-189a-48e0-8a51-a2370fbc888a None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:41.572620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a1f6529b-189a-48e0-8a51-a2370fbc888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:41.593666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 232/462] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:41 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:41.614874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827824d-4225-41fc-a0a6-118419d2e9aa None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:41.627234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827824d-4225-41fc-a0a6-118419d2e9aa None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:41.631114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476a15f-380b-40cf-bdcc-e1ca3ffab519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:41.631855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476a15f-380b-40cf-bdcc-e1ca3ffab519 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:41.632143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476a15f-380b-40cf-bdcc-e1ca3ffab519 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:41.632420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476a15f-380b-40cf-bdcc-e1ca3ffab519 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:41.633033 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476a15f-380b-40cf-bdcc-e1ca3ffab519 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:41.659636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476a15f-380b-40cf-bdcc-e1ca3ffab519 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:41.670089 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-9476a15f-380b-40cf-bdcc-e1ca3ffab519 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 18 12:39:41.671133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 231/463] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:41.676747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6529b-189a-48e0-8a51-a2370fbc888a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:41.685969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6529b-189a-48e0-8a51-a2370fbc888a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:41.689928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03085485-5ac4-4ba8-a561-caafc7dd6f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:41.690510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03085485-5ac4-4ba8-a561-caafc7dd6f48 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:41.690795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03085485-5ac4-4ba8-a561-caafc7dd6f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:41.691073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03085485-5ac4-4ba8-a561-caafc7dd6f48 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:41.691762 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03085485-5ac4-4ba8-a561-caafc7dd6f48 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:41.692058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03085485-5ac4-4ba8-a561-caafc7dd6f48 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:41.717967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03085485-5ac4-4ba8-a561-caafc7dd6f48 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:41.722323 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 233/464] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:39:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:41.727655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476a15f-380b-40cf-bdcc-e1ca3ffab519 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:41.737891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476a15f-380b-40cf-bdcc-e1ca3ffab519 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:41.741900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050573e7-4afd-43cd-b992-e7a57d8f7639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:41.742473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050573e7-4afd-43cd-b992-e7a57d8f7639 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:41.742758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050573e7-4afd-43cd-b992-e7a57d8f7639 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:41.743039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050573e7-4afd-43cd-b992-e7a57d8f7639 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:41.743732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050573e7-4afd-43cd-b992-e7a57d8f7639 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:41.744031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050573e7-4afd-43cd-b992-e7a57d8f7639 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:41.770220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050573e7-4afd-43cd-b992-e7a57d8f7639 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:41.774810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 232/465] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:39:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:43.804830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d9397-c876-42ba-9bb8-98fff6f60f01 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:43.805382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d9397-c876-42ba-9bb8-98fff6f60f01 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:43.805474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d9397-c876-42ba-9bb8-98fff6f60f01 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:43.807110 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 234/466] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:43.812530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfbb70-4207-4d1b-93a3-e6b3d5afc7af None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:43.812994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfbb70-4207-4d1b-93a3-e6b3d5afc7af None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:43.813090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfbb70-4207-4d1b-93a3-e6b3d5afc7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:43.834820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-bcbfbb70-4207-4d1b-93a3-e6b3d5afc7af None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:43.835960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bcbfbb70-4207-4d1b-93a3-e6b3d5afc7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:43.843402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 233/467] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:43 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:43.865351 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d9397-c876-42ba-9bb8-98fff6f60f01 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:43.877025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d9397-c876-42ba-9bb8-98fff6f60f01 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:43.880898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f9ef8-3283-4337-8434-da58aa4e4577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:43.881475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f9ef8-3283-4337-8434-da58aa4e4577 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:43.881770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f9ef8-3283-4337-8434-da58aa4e4577 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:43.882056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f9ef8-3283-4337-8434-da58aa4e4577 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:43.882736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f9ef8-3283-4337-8434-da58aa4e4577 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:43.908414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-0c6f9ef8-3283-4337-8434-da58aa4e4577 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:43.908414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:39:43.908414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:39:43.909550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f9ef8-3283-4337-8434-da58aa4e4577 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:43.985365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 235/468] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:39:43 2022] POST /identity/v3/services => generated 242 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:39:45.963585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22f909-6550-4ed3-87c7-c02b25de16fb None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:45.964280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22f909-6550-4ed3-87c7-c02b25de16fb None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:45.964280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22f909-6550-4ed3-87c7-c02b25de16fb None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:45.965951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 234/469] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:45.971504 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ecfe-9eae-4fdf-a93c-aa63a446e545 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:45.971937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ecfe-9eae-4fdf-a93c-aa63a446e545 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:45.972075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27ecfe-9eae-4fdf-a93c-aa63a446e545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:45.994742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-de27ecfe-9eae-4fdf-a93c-aa63a446e545 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:45.996394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-de27ecfe-9eae-4fdf-a93c-aa63a446e545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:46.013608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 236/470] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:45 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:46.036666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22f909-6550-4ed3-87c7-c02b25de16fb None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:46.048262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22f909-6550-4ed3-87c7-c02b25de16fb None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:46.052367 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247df228-0bf3-4e9a-bd9c-05b7e47066eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:46.053015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247df228-0bf3-4e9a-bd9c-05b7e47066eb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:46.053297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247df228-0bf3-4e9a-bd9c-05b7e47066eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:46.053574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247df228-0bf3-4e9a-bd9c-05b7e47066eb admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:46.054190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247df228-0bf3-4e9a-bd9c-05b7e47066eb admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:46.080536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247df228-0bf3-4e9a-bd9c-05b7e47066eb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:46.090956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-247df228-0bf3-4e9a-bd9c-05b7e47066eb admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 18 12:39:46.092091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 235/471] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:46.097761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27ecfe-9eae-4fdf-a93c-aa63a446e545 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:46.106369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27ecfe-9eae-4fdf-a93c-aa63a446e545 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:46.110310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223c3c4-9ceb-42c7-91a1-61270e746278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:46.110889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223c3c4-9ceb-42c7-91a1-61270e746278 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:46.111174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223c3c4-9ceb-42c7-91a1-61270e746278 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:46.111489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223c3c4-9ceb-42c7-91a1-61270e746278 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:46.112151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223c3c4-9ceb-42c7-91a1-61270e746278 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:46.112449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223c3c4-9ceb-42c7-91a1-61270e746278 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:46.138848 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223c3c4-9ceb-42c7-91a1-61270e746278 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:46.143279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 237/472] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:39:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:46.148750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247df228-0bf3-4e9a-bd9c-05b7e47066eb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:46.158096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247df228-0bf3-4e9a-bd9c-05b7e47066eb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:46.162299 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723a515-386a-46b4-a967-2d7d3c050243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:46.162879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723a515-386a-46b4-a967-2d7d3c050243 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:46.163168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723a515-386a-46b4-a967-2d7d3c050243 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:46.163489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723a515-386a-46b4-a967-2d7d3c050243 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:46.164161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723a515-386a-46b4-a967-2d7d3c050243 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:46.164462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723a515-386a-46b4-a967-2d7d3c050243 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:46.190167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723a515-386a-46b4-a967-2d7d3c050243 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:46.194900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 236/473] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:39:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:46.200977 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223c3c4-9ceb-42c7-91a1-61270e746278 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:46.210045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223c3c4-9ceb-42c7-91a1-61270e746278 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:46.214165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44a459-b3cc-47ea-9674-c127d09d96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:46.214791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a459-b3cc-47ea-9674-c127d09d96dc admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:46.215090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a459-b3cc-47ea-9674-c127d09d96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:46.215406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44a459-b3cc-47ea-9674-c127d09d96dc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:46.216157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44a459-b3cc-47ea-9674-c127d09d96dc admin admin] RBAC: Adding query filter params (interface=public, service_id=12120ba69cbe4520bd957a182812dd92, region_id=RegionOne) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:46.216468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44a459-b3cc-47ea-9674-c127d09d96dc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:46.241134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-ab44a459-b3cc-47ea-9674-c127d09d96dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:46.241134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:39:46.241134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:39:46.241998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44a459-b3cc-47ea-9674-c127d09d96dc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:46.248671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 238/474] 10.222.0.87 () {56 vars in 1272 bytes} [Tue Jan 18 12:39:46 2022] GET /identity/v3/endpoints?service_id=12120ba69cbe4520bd957a182812dd92&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:46.254096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723a515-386a-46b4-a967-2d7d3c050243 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:46.264071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723a515-386a-46b4-a967-2d7d3c050243 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:46.268120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99abdc-9f35-4d4d-a201-f9a64ef945a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:46.268705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99abdc-9f35-4d4d-a201-f9a64ef945a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:46.268989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99abdc-9f35-4d4d-a201-f9a64ef945a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:46.269323 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99abdc-9f35-4d4d-a201-f9a64ef945a0 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:46.270002 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99abdc-9f35-4d4d-a201-f9a64ef945a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:46.296141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99abdc-9f35-4d4d-a201-f9a64ef945a0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:46.301714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 237/475] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:39:46 2022] GET /identity/v3/services => generated 792 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:48.308635 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c991b1-2042-4999-a4b2-edd1734095bd None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:48.309154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c991b1-2042-4999-a4b2-edd1734095bd None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:48.309243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c991b1-2042-4999-a4b2-edd1734095bd None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:48.310959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 239/476] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:48.316100 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd92f-508d-4e65-b8d9-fcab996cc5a1 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:48.316529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd92f-508d-4e65-b8d9-fcab996cc5a1 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:48.316660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3dd92f-508d-4e65-b8d9-fcab996cc5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:48.340213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4a3dd92f-508d-4e65-b8d9-fcab996cc5a1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:48.341376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4a3dd92f-508d-4e65-b8d9-fcab996cc5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:48.348067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 238/477] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:48 2022] POST /identity/v3/auth/tokens => generated 1460 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:48.370663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c991b1-2042-4999-a4b2-edd1734095bd None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:48.382275 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c991b1-2042-4999-a4b2-edd1734095bd None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:48.386765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f78d-76c7-4ee7-bbb2-162363b5894e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:48.387497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f78d-76c7-4ee7-bbb2-162363b5894e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:48.387791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f78d-76c7-4ee7-bbb2-162363b5894e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:48.388071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f78d-76c7-4ee7-bbb2-162363b5894e admin admin] PATH_INFO: `/v3/services/compute` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:48.388794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972f78d-76c7-4ee7-bbb2-162363b5894e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:48.429483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972f78d-76c7-4ee7-bbb2-162363b5894e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:48.446242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-a972f78d-76c7-4ee7-bbb2-162363b5894e admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 18 12:39:48.447506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 240/478] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:48.455234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dd92f-508d-4e65-b8d9-fcab996cc5a1 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:48.467130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3dd92f-508d-4e65-b8d9-fcab996cc5a1 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:48.471178 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b5f4d-ed41-4475-bf83-e80e05a768ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:48.471799 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5f4d-ed41-4475-bf83-e80e05a768ee admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:48.472085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5f4d-ed41-4475-bf83-e80e05a768ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:48.472369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5f4d-ed41-4475-bf83-e80e05a768ee admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:48.473283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b5f4d-ed41-4475-bf83-e80e05a768ee admin admin] RBAC: Adding query filter params (name=compute) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:48.473578 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b5f4d-ed41-4475-bf83-e80e05a768ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:48.502410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b5f4d-ed41-4475-bf83-e80e05a768ee admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:48.507394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 239/479] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:39:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:48.514146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f78d-76c7-4ee7-bbb2-162363b5894e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:48.523769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f78d-76c7-4ee7-bbb2-162363b5894e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:48.528402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e5876-4fb5-4c20-a4f3-f9f2ff07b6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:48.528995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5876-4fb5-4c20-a4f3-f9f2ff07b6ed admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:48.529285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5876-4fb5-4c20-a4f3-f9f2ff07b6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:48.529570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e5876-4fb5-4c20-a4f3-f9f2ff07b6ed admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:48.530241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e5876-4fb5-4c20-a4f3-f9f2ff07b6ed admin admin] RBAC: Adding query filter params (type=compute) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:48.530543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e5876-4fb5-4c20-a4f3-f9f2ff07b6ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:48.560742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e5876-4fb5-4c20-a4f3-f9f2ff07b6ed admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:48.565632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 241/480] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:39:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:48.571194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b5f4d-ed41-4475-bf83-e80e05a768ee admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:48.581055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b5f4d-ed41-4475-bf83-e80e05a768ee admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:48.585001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc4f75-b4f4-475c-ba80-414536ea3bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:48.585575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc4f75-b4f4-475c-ba80-414536ea3bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:48.585860 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc4f75-b4f4-475c-ba80-414536ea3bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:48.586139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc4f75-b4f4-475c-ba80-414536ea3bf0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:48.586830 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc4f75-b4f4-475c-ba80-414536ea3bf0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:48.611958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-88fc4f75-b4f4-475c-ba80-414536ea3bf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:39:48.611958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:39:48.611958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:39:48.612764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc4f75-b4f4-475c-ba80-414536ea3bf0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:48.730636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 240/481] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:39:48 2022] POST /identity/v3/endpoints => generated 334 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:39:50.859135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f285f1-d93d-495b-869f-af8bc00f2ba8 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:50.859703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f285f1-d93d-495b-869f-af8bc00f2ba8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:50.859808 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f285f1-d93d-495b-869f-af8bc00f2ba8 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:50.862331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 242/482] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:50.867443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672874f6-01a1-427d-ba5d-a79c41dd9314 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:50.867883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672874f6-01a1-427d-ba5d-a79c41dd9314 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:50.868010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672874f6-01a1-427d-ba5d-a79c41dd9314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:50.890012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-672874f6-01a1-427d-ba5d-a79c41dd9314 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:50.891149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-672874f6-01a1-427d-ba5d-a79c41dd9314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:50.907687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 241/483] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:50 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:50.930761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f285f1-d93d-495b-869f-af8bc00f2ba8 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:50.942131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f285f1-d93d-495b-869f-af8bc00f2ba8 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:50.945937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724d833-8d5f-4ec5-9a76-3cd35bd7dc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:50.946652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724d833-8d5f-4ec5-9a76-3cd35bd7dc43 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:50.946935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724d833-8d5f-4ec5-9a76-3cd35bd7dc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:50.947208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0724d833-8d5f-4ec5-9a76-3cd35bd7dc43 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:50.959841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0724d833-8d5f-4ec5-9a76-3cd35bd7dc43 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:50.967214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-0724d833-8d5f-4ec5-9a76-3cd35bd7dc43 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 18 12:39:50.968354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 243/484] 10.222.0.87 () {56 vars in 1141 bytes} [Tue Jan 18 12:39:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:50.974111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672874f6-01a1-427d-ba5d-a79c41dd9314 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:50.983149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672874f6-01a1-427d-ba5d-a79c41dd9314 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:50.987398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9cd67-acac-4269-aac7-e11e58fb7ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:50.987991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9cd67-acac-4269-aac7-e11e58fb7ccf admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:50.988281 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9cd67-acac-4269-aac7-e11e58fb7ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:50.988564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9cd67-acac-4269-aac7-e11e58fb7ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:50.989279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9cd67-acac-4269-aac7-e11e58fb7ccf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:50.989579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9cd67-acac-4269-aac7-e11e58fb7ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.015504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9cd67-acac-4269-aac7-e11e58fb7ccf admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.024207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 242/485] 10.222.0.87 () {56 vars in 1136 bytes} [Tue Jan 18 12:39:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:51.030885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724d833-8d5f-4ec5-9a76-3cd35bd7dc43 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.040520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0724d833-8d5f-4ec5-9a76-3cd35bd7dc43 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.044991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f08850-fb7d-4367-b1c2-3b9ad66562e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.045703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f08850-fb7d-4367-b1c2-3b9ad66562e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.045996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f08850-fb7d-4367-b1c2-3b9ad66562e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.046282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f08850-fb7d-4367-b1c2-3b9ad66562e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.058327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f08850-fb7d-4367-b1c2-3b9ad66562e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.084852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f08850-fb7d-4367-b1c2-3b9ad66562e2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.103051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-01f08850-fb7d-4367-b1c2-3b9ad66562e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:51.104183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 244/486] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:51.109781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9cd67-acac-4269-aac7-e11e58fb7ccf admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.118922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9cd67-acac-4269-aac7-e11e58fb7ccf admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.123262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f0345-1dec-4806-8923-8a82706e4255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.123875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0345-1dec-4806-8923-8a82706e4255 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.124164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0345-1dec-4806-8923-8a82706e4255 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.124447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f0345-1dec-4806-8923-8a82706e4255 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.125131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f0345-1dec-4806-8923-8a82706e4255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:51.125428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f0345-1dec-4806-8923-8a82706e4255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.152550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38f0345-1dec-4806-8923-8a82706e4255 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.170877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 243/487] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:51.176741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f08850-fb7d-4367-b1c2-3b9ad66562e2 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.188654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f08850-fb7d-4367-b1c2-3b9ad66562e2 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.192725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b202-0d76-4924-968e-02bb88a43b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.193470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b202-0d76-4924-968e-02bb88a43b74 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.193753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b202-0d76-4924-968e-02bb88a43b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.194029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b202-0d76-4924-968e-02bb88a43b74 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.208898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49b202-0d76-4924-968e-02bb88a43b74 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.235297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49b202-0d76-4924-968e-02bb88a43b74 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.253082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-7a49b202-0d76-4924-968e-02bb88a43b74 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 18 12:39:51.254231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 245/488] 10.222.0.87 () {56 vars in 1114 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:51.259877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f0345-1dec-4806-8923-8a82706e4255 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.269718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38f0345-1dec-4806-8923-8a82706e4255 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.273761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cafadb-f15f-4069-bb07-7d5f4ccffd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.274355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cafadb-f15f-4069-bb07-7d5f4ccffd86 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.274641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cafadb-f15f-4069-bb07-7d5f4ccffd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.274921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cafadb-f15f-4069-bb07-7d5f4ccffd86 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.275750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cafadb-f15f-4069-bb07-7d5f4ccffd86 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:51.276053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cafadb-f15f-4069-bb07-7d5f4ccffd86 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.303567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cafadb-f15f-4069-bb07-7d5f4ccffd86 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.346990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 244/489] 10.222.0.87 () {56 vars in 1154 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:51.352646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b202-0d76-4924-968e-02bb88a43b74 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.364770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b202-0d76-4924-968e-02bb88a43b74 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.368654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d2cbc-20cb-4ca4-b4f9-a2cbe2a480f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.369219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d2cbc-20cb-4ca4-b4f9-a2cbe2a480f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.369544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d2cbc-20cb-4ca4-b4f9-a2cbe2a480f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.369850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d2cbc-20cb-4ca4-b4f9-a2cbe2a480f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.379513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d2cbc-20cb-4ca4-b4f9-a2cbe2a480f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.415334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d2cbc-20cb-4ca4-b4f9-a2cbe2a480f7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.427357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 246/490] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:39:51.433756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cafadb-f15f-4069-bb07-7d5f4ccffd86 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.445011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cafadb-f15f-4069-bb07-7d5f4ccffd86 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.450281 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89749-18d6-4df1-9f5c-7491590f1c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.451088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89749-18d6-4df1-9f5c-7491590f1c55 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.451416 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89749-18d6-4df1-9f5c-7491590f1c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.451701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89749-18d6-4df1-9f5c-7491590f1c55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.469903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f89749-18d6-4df1-9f5c-7491590f1c55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.503215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f89749-18d6-4df1-9f5c-7491590f1c55 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.527286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b7f89749-18d6-4df1-9f5c-7491590f1c55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:51.528520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 245/491] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:51.534380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d2cbc-20cb-4ca4-b4f9-a2cbe2a480f7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.546516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d2cbc-20cb-4ca4-b4f9-a2cbe2a480f7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.552082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ced1ef-b40e-4537-8816-2b46b2447922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.553064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced1ef-b40e-4537-8816-2b46b2447922 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.553529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced1ef-b40e-4537-8816-2b46b2447922 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.553987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ced1ef-b40e-4537-8816-2b46b2447922 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.555135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ced1ef-b40e-4537-8816-2b46b2447922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:51.555685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ced1ef-b40e-4537-8816-2b46b2447922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.591905 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ced1ef-b40e-4537-8816-2b46b2447922 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.608245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 247/492] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:51.615555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89749-18d6-4df1-9f5c-7491590f1c55 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.626038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89749-18d6-4df1-9f5c-7491590f1c55 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.630275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559ed9c-8f6a-4410-9749-70a63158f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.630990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559ed9c-8f6a-4410-9749-70a63158f78f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.631326 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559ed9c-8f6a-4410-9749-70a63158f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.634085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559ed9c-8f6a-4410-9749-70a63158f78f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.644655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559ed9c-8f6a-4410-9749-70a63158f78f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.680808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559ed9c-8f6a-4410-9749-70a63158f78f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.697067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-8559ed9c-8f6a-4410-9749-70a63158f78f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:39:51.698751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 246/493] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:51.705907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ced1ef-b40e-4537-8816-2b46b2447922 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.716036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ced1ef-b40e-4537-8816-2b46b2447922 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.721590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf140db1-2c2d-4479-8b16-fc66fe8c81cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.722179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140db1-2c2d-4479-8b16-fc66fe8c81cf admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.722553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140db1-2c2d-4479-8b16-fc66fe8c81cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.722840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf140db1-2c2d-4479-8b16-fc66fe8c81cf admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.723617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf140db1-2c2d-4479-8b16-fc66fe8c81cf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:51.723923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf140db1-2c2d-4479-8b16-fc66fe8c81cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.751955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf140db1-2c2d-4479-8b16-fc66fe8c81cf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.768634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 248/494] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:51.774620 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559ed9c-8f6a-4410-9749-70a63158f78f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:51.785284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559ed9c-8f6a-4410-9749-70a63158f78f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:51.789741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eb0df-6c2a-4318-9e8c-b354fe15998a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:51.790434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb0df-6c2a-4318-9e8c-b354fe15998a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:51.790722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb0df-6c2a-4318-9e8c-b354fe15998a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:51.791004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb0df-6c2a-4318-9e8c-b354fe15998a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:51.791836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb0df-6c2a-4318-9e8c-b354fe15998a admin admin] RBAC: Adding query filter params (role.id=8f3f7f63a59d41099278b8a851d40286, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=394a96c082ed47bbbd645b489a4ed208) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:51.792140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb0df-6c2a-4318-9e8c-b354fe15998a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:51.818539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb0df-6c2a-4318-9e8c-b354fe15998a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:51.825150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 247/495] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:39:51 2022] GET /identity/v3/role_assignments?user.id=394a96c082ed47bbbd645b489a4ed208&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=8f3f7f63a59d41099278b8a851d40286 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:53.849138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56647a-671a-439e-bf77-ae257e72f9df None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:53.849736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56647a-671a-439e-bf77-ae257e72f9df None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:53.849736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56647a-671a-439e-bf77-ae257e72f9df None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:53.851377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 249/496] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:53.856935 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7ce52-611b-4a96-9923-e81282133e68 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:53.857325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7ce52-611b-4a96-9923-e81282133e68 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:53.857504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7ce52-611b-4a96-9923-e81282133e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:53.880209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-35a7ce52-611b-4a96-9923-e81282133e68 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:53.881350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-35a7ce52-611b-4a96-9923-e81282133e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:53.888689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 248/497] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:53 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:53.910307 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56647a-671a-439e-bf77-ae257e72f9df None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:53.924918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f56647a-671a-439e-bf77-ae257e72f9df None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:53.929412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875223e-ed2d-4690-8291-5ed16b866364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:53.930302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875223e-ed2d-4690-8291-5ed16b866364 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:53.930810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875223e-ed2d-4690-8291-5ed16b866364 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:53.931330 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875223e-ed2d-4690-8291-5ed16b866364 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:53.946517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875223e-ed2d-4690-8291-5ed16b866364 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:53.953661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-9875223e-ed2d-4690-8291-5ed16b866364 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 18 12:39:53.954768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 250/498] 10.222.0.87 () {56 vars in 1141 bytes} [Tue Jan 18 12:39:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:53.962602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7ce52-611b-4a96-9923-e81282133e68 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:53.971231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7ce52-611b-4a96-9923-e81282133e68 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:53.975333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c75f1-7704-41fb-8774-3fb47b846d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:53.975924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c75f1-7704-41fb-8774-3fb47b846d3e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:53.976206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c75f1-7704-41fb-8774-3fb47b846d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:53.976484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c75f1-7704-41fb-8774-3fb47b846d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:53.977244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c75f1-7704-41fb-8774-3fb47b846d3e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:53.977540 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c75f1-7704-41fb-8774-3fb47b846d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.004370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c75f1-7704-41fb-8774-3fb47b846d3e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.013419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 249/499] 10.222.0.87 () {56 vars in 1136 bytes} [Tue Jan 18 12:39:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:39:54.018966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875223e-ed2d-4690-8291-5ed16b866364 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:54.030718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875223e-ed2d-4690-8291-5ed16b866364 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:54.035022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9cc26-f2c0-4b4a-8ea7-aa0639173798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:54.035763 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9cc26-f2c0-4b4a-8ea7-aa0639173798 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:54.036055 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9cc26-f2c0-4b4a-8ea7-aa0639173798 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:54.036336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9cc26-f2c0-4b4a-8ea7-aa0639173798 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:54.048040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9cc26-f2c0-4b4a-8ea7-aa0639173798 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.074205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9cc26-f2c0-4b4a-8ea7-aa0639173798 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.092477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-eaf9cc26-f2c0-4b4a-8ea7-aa0639173798 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:54.093578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 251/500] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:54.099133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c75f1-7704-41fb-8774-3fb47b846d3e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:54.109412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c75f1-7704-41fb-8774-3fb47b846d3e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:54.113313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b9398-d02c-431b-99de-391606907ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:54.113894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b9398-d02c-431b-99de-391606907ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:54.114209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b9398-d02c-431b-99de-391606907ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:54.114496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b9398-d02c-431b-99de-391606907ed0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:54.115182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b9398-d02c-431b-99de-391606907ed0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:54.115522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b9398-d02c-431b-99de-391606907ed0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.142132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b9398-d02c-431b-99de-391606907ed0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.155093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 250/501] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:54.160681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9cc26-f2c0-4b4a-8ea7-aa0639173798 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:54.170364 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9cc26-f2c0-4b4a-8ea7-aa0639173798 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:54.174365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef0b0-8064-4dee-802d-fb8272309399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:54.175065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef0b0-8064-4dee-802d-fb8272309399 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:54.175389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef0b0-8064-4dee-802d-fb8272309399 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:54.175675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef0b0-8064-4dee-802d-fb8272309399 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:54.188666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcef0b0-8064-4dee-802d-fb8272309399 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.214921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcef0b0-8064-4dee-802d-fb8272309399 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.239250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-4dcef0b0-8064-4dee-802d-fb8272309399 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 18 12:39:54.240399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 252/502] 10.222.0.87 () {56 vars in 1114 bytes} [Tue Jan 18 12:39:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:54.246732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b9398-d02c-431b-99de-391606907ed0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:54.256736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b9398-d02c-431b-99de-391606907ed0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:54.260994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4490c90-9f93-4dec-841e-a68669534f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:54.261602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4490c90-9f93-4dec-841e-a68669534f68 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:54.262072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4490c90-9f93-4dec-841e-a68669534f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:54.262395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4490c90-9f93-4dec-841e-a68669534f68 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:54.263147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4490c90-9f93-4dec-841e-a68669534f68 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:54.263473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4490c90-9f93-4dec-841e-a68669534f68 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.289513 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4490c90-9f93-4dec-841e-a68669534f68 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.318946 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 251/503] 10.222.0.87 () {56 vars in 1154 bytes} [Tue Jan 18 12:39:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:39:54.324514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef0b0-8064-4dee-802d-fb8272309399 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:54.333676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef0b0-8064-4dee-802d-fb8272309399 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:54.337608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2c45-30b3-43a7-8dd5-8716fa917cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:54.338315 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2c45-30b3-43a7-8dd5-8716fa917cdd admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:54.339155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2c45-30b3-43a7-8dd5-8716fa917cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:54.339482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2c45-30b3-43a7-8dd5-8716fa917cdd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:54.351738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c2c45-30b3-43a7-8dd5-8716fa917cdd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.377723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c2c45-30b3-43a7-8dd5-8716fa917cdd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.395064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-cb0c2c45-30b3-43a7-8dd5-8716fa917cdd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:54.396175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 253/504] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:54.402665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4490c90-9f93-4dec-841e-a68669534f68 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:54.412231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4490c90-9f93-4dec-841e-a68669534f68 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:54.416196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15111b3b-fb64-4d82-9350-aa3fcc6247b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:54.417514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15111b3b-fb64-4d82-9350-aa3fcc6247b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:54.417842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15111b3b-fb64-4d82-9350-aa3fcc6247b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:54.418216 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15111b3b-fb64-4d82-9350-aa3fcc6247b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:54.418907 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15111b3b-fb64-4d82-9350-aa3fcc6247b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:54.419213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15111b3b-fb64-4d82-9350-aa3fcc6247b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.444861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15111b3b-fb64-4d82-9350-aa3fcc6247b4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.457330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 252/505] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:54.462613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2c45-30b3-43a7-8dd5-8716fa917cdd admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:54.472206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2c45-30b3-43a7-8dd5-8716fa917cdd admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:54.476087 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e34a7-167e-48d3-9693-434a5391306b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:54.476783 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e34a7-167e-48d3-9693-434a5391306b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:54.477067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e34a7-167e-48d3-9693-434a5391306b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:54.477344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e34a7-167e-48d3-9693-434a5391306b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:54.486963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e34a7-167e-48d3-9693-434a5391306b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.512733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e34a7-167e-48d3-9693-434a5391306b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.527567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-4c4e34a7-167e-48d3-9693-434a5391306b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:39:54.528662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 254/506] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:54.534527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15111b3b-fb64-4d82-9350-aa3fcc6247b4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:54.544616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15111b3b-fb64-4d82-9350-aa3fcc6247b4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:54.548596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229359c-990a-430e-9822-34aa93298e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:54.549182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229359c-990a-430e-9822-34aa93298e8e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:54.549470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229359c-990a-430e-9822-34aa93298e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:54.549752 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229359c-990a-430e-9822-34aa93298e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:54.550496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229359c-990a-430e-9822-34aa93298e8e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:54.550801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229359c-990a-430e-9822-34aa93298e8e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.576072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229359c-990a-430e-9822-34aa93298e8e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.589896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 253/507] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:54.595583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e34a7-167e-48d3-9693-434a5391306b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:54.605771 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e34a7-167e-48d3-9693-434a5391306b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:54.609802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a0cf0-dbab-43f0-b527-12349e17df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:54.610607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a0cf0-dbab-43f0-b527-12349e17df5c admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:54.610898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a0cf0-dbab-43f0-b527-12349e17df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:54.611182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a0cf0-dbab-43f0-b527-12349e17df5c admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/394a96c082ed47bbbd645b489a4ed208/roles/8f3f7f63a59d41099278b8a851d40286` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:54.613347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a0cf0-dbab-43f0-b527-12349e17df5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=394a96c082ed47bbbd645b489a4ed208, role_id=8f3f7f63a59d41099278b8a851d40286)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:54.640650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a0cf0-dbab-43f0-b527-12349e17df5c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:54.726582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 255/508] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:39:54 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/394a96c082ed47bbbd645b489a4ed208/roles/8f3f7f63a59d41099278b8a851d40286 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:39:56.701850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e037-4106-4b96-b136-b78ebea28d57 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:56.702403 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e037-4106-4b96-b136-b78ebea28d57 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:56.702403 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523e037-4106-4b96-b136-b78ebea28d57 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:56.704123 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 254/509] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:56.709160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26709c26-de4f-49ca-9599-94e891010c94 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:56.709553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26709c26-de4f-49ca-9599-94e891010c94 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:56.709725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26709c26-de4f-49ca-9599-94e891010c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:56.733202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-26709c26-de4f-49ca-9599-94e891010c94 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:56.734311 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-26709c26-de4f-49ca-9599-94e891010c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:56.797409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 256/510] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:56 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:56.819657 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523e037-4106-4b96-b136-b78ebea28d57 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:56.831233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523e037-4106-4b96-b136-b78ebea28d57 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:56.835359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d49f8-f6a8-4613-87ad-b680bcc159fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:56.836089 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d49f8-f6a8-4613-87ad-b680bcc159fb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:56.836378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d49f8-f6a8-4613-87ad-b680bcc159fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:56.836658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d49f8-f6a8-4613-87ad-b680bcc159fb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:56.848777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d49f8-f6a8-4613-87ad-b680bcc159fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:39:56.856336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-f98d49f8-f6a8-4613-87ad-b680bcc159fb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 18 12:39:56.857419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 255/511] 10.222.0.87 () {56 vars in 1141 bytes} [Tue Jan 18 12:39:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:56.863319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26709c26-de4f-49ca-9599-94e891010c94 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:56.872636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26709c26-de4f-49ca-9599-94e891010c94 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:56.878865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c044a-3b30-44d7-aa6f-d561eab51e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:56.879502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c044a-3b30-44d7-aa6f-d561eab51e34 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:56.879796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c044a-3b30-44d7-aa6f-d561eab51e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:56.880078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c044a-3b30-44d7-aa6f-d561eab51e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:56.880787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c044a-3b30-44d7-aa6f-d561eab51e34 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:56.881089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c044a-3b30-44d7-aa6f-d561eab51e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:56.906994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c044a-3b30-44d7-aa6f-d561eab51e34 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:56.916182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 257/512] 10.222.0.87 () {56 vars in 1136 bytes} [Tue Jan 18 12:39:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:56.922314 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d49f8-f6a8-4613-87ad-b680bcc159fb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:56.933046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d49f8-f6a8-4613-87ad-b680bcc159fb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:56.937239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc66805-fd28-48b6-ae19-99f99d290725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:56.937951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc66805-fd28-48b6-ae19-99f99d290725 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:56.938238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc66805-fd28-48b6-ae19-99f99d290725 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:56.938519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc66805-fd28-48b6-ae19-99f99d290725 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:56.950877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc66805-fd28-48b6-ae19-99f99d290725 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:56.977440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc66805-fd28-48b6-ae19-99f99d290725 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:56.995805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-4fc66805-fd28-48b6-ae19-99f99d290725 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:56.996896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 256/513] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:57.002521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c044a-3b30-44d7-aa6f-d561eab51e34 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:57.012861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c044a-3b30-44d7-aa6f-d561eab51e34 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:57.016847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655312a-4847-4e0e-9ed8-4e56ee188f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:57.017422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655312a-4847-4e0e-9ed8-4e56ee188f60 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:57.017711 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655312a-4847-4e0e-9ed8-4e56ee188f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:57.017988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655312a-4847-4e0e-9ed8-4e56ee188f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:57.018663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655312a-4847-4e0e-9ed8-4e56ee188f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:57.018961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655312a-4847-4e0e-9ed8-4e56ee188f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:57.045703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655312a-4847-4e0e-9ed8-4e56ee188f60 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:57.058930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 258/514] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:57.064633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc66805-fd28-48b6-ae19-99f99d290725 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:57.074585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc66805-fd28-48b6-ae19-99f99d290725 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:57.078713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771c524-4222-49d3-9d79-d8f9f77ad9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:57.079451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771c524-4222-49d3-9d79-d8f9f77ad9ef admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:57.079746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771c524-4222-49d3-9d79-d8f9f77ad9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:57.080031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771c524-4222-49d3-9d79-d8f9f77ad9ef admin admin] PATH_INFO: `/v3/users/nova` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:57.093257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771c524-4222-49d3-9d79-d8f9f77ad9ef admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:57.119541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771c524-4222-49d3-9d79-d8f9f77ad9ef admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:57.137905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-3771c524-4222-49d3-9d79-d8f9f77ad9ef admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 18 12:39:57.138981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 257/515] 10.222.0.87 () {56 vars in 1114 bytes} [Tue Jan 18 12:39:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:57.144534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655312a-4847-4e0e-9ed8-4e56ee188f60 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:57.154372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655312a-4847-4e0e-9ed8-4e56ee188f60 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:57.158669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544bbb4-100b-4fab-a6f4-3cc2287021fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:57.159254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544bbb4-100b-4fab-a6f4-3cc2287021fe admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:57.159576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544bbb4-100b-4fab-a6f4-3cc2287021fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:57.159859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544bbb4-100b-4fab-a6f4-3cc2287021fe admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:57.160629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544bbb4-100b-4fab-a6f4-3cc2287021fe admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:57.161040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544bbb4-100b-4fab-a6f4-3cc2287021fe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:57.186431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544bbb4-100b-4fab-a6f4-3cc2287021fe admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:57.215904 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 259/516] 10.222.0.87 () {56 vars in 1154 bytes} [Tue Jan 18 12:39:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:57.221346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771c524-4222-49d3-9d79-d8f9f77ad9ef admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:57.230614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771c524-4222-49d3-9d79-d8f9f77ad9ef admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:57.234495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bca81-af5c-48b1-820e-d7481972cb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:57.235060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bca81-af5c-48b1-820e-d7481972cb62 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:57.235380 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bca81-af5c-48b1-820e-d7481972cb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:57.235667 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bca81-af5c-48b1-820e-d7481972cb62 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:57.243202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bca81-af5c-48b1-820e-d7481972cb62 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:57.269560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bca81-af5c-48b1-820e-d7481972cb62 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:57.278571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 258/517] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:39:57 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:39:57.284257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544bbb4-100b-4fab-a6f4-3cc2287021fe admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:57.293523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544bbb4-100b-4fab-a6f4-3cc2287021fe admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:57.297406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347d615-b442-474e-8141-315bb93728b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:57.298107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347d615-b442-474e-8141-315bb93728b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:57.298394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347d615-b442-474e-8141-315bb93728b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:57.298671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347d615-b442-474e-8141-315bb93728b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:57.310792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347d615-b442-474e-8141-315bb93728b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:57.336576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347d615-b442-474e-8141-315bb93728b8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:57.353148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-6347d615-b442-474e-8141-315bb93728b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:57.354269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 260/518] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:57.359782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bca81-af5c-48b1-820e-d7481972cb62 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:57.368422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bca81-af5c-48b1-820e-d7481972cb62 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:57.372960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789e712-72e7-46e7-a43a-78069ed77664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:57.373538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789e712-72e7-46e7-a43a-78069ed77664 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:57.373826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789e712-72e7-46e7-a43a-78069ed77664 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:57.374155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789e712-72e7-46e7-a43a-78069ed77664 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:57.374834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789e712-72e7-46e7-a43a-78069ed77664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:57.375132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789e712-72e7-46e7-a43a-78069ed77664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:57.401245 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789e712-72e7-46e7-a43a-78069ed77664 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:57.414503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 259/519] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:57.419974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347d615-b442-474e-8141-315bb93728b8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:57.429124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347d615-b442-474e-8141-315bb93728b8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:57.434158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ae8e3-5dc3-4290-9f33-58544088f3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:57.434871 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ae8e3-5dc3-4290-9f33-58544088f3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:57.435158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ae8e3-5dc3-4290-9f33-58544088f3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:57.435481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ae8e3-5dc3-4290-9f33-58544088f3a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:57.446088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ae8e3-5dc3-4290-9f33-58544088f3a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:57.474387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ae8e3-5dc3-4290-9f33-58544088f3a4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:57.488545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-598ae8e3-5dc3-4290-9f33-58544088f3a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:39:57.489555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 261/520] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:57.496048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789e712-72e7-46e7-a43a-78069ed77664 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:57.505374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789e712-72e7-46e7-a43a-78069ed77664 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:57.509315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9a243-19c2-413d-bb8d-0eddc524e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:57.509897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9a243-19c2-413d-bb8d-0eddc524e94d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:57.510207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9a243-19c2-413d-bb8d-0eddc524e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:57.511045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9a243-19c2-413d-bb8d-0eddc524e94d admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:57.511824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9a243-19c2-413d-bb8d-0eddc524e94d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:57.512128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9a243-19c2-413d-bb8d-0eddc524e94d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:57.538382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9a243-19c2-413d-bb8d-0eddc524e94d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:57.552077 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 260/521] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:39:57.557949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ae8e3-5dc3-4290-9f33-58544088f3a4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:57.567360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ae8e3-5dc3-4290-9f33-58544088f3a4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:57.571254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475f159-fbeb-4a87-8b3a-6c8eab98afe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:57.571858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475f159-fbeb-4a87-8b3a-6c8eab98afe5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:57.572150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475f159-fbeb-4a87-8b3a-6c8eab98afe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:57.572433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475f159-fbeb-4a87-8b3a-6c8eab98afe5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:57.573319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475f159-fbeb-4a87-8b3a-6c8eab98afe5 admin admin] RBAC: Adding query filter params (role.id=8f3f7f63a59d41099278b8a851d40286, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=394a96c082ed47bbbd645b489a4ed208) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:57.573623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475f159-fbeb-4a87-8b3a-6c8eab98afe5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:57.599731 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475f159-fbeb-4a87-8b3a-6c8eab98afe5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:57.606213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 262/522] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:39:57 2022] GET /identity/v3/role_assignments?user.id=394a96c082ed47bbbd645b489a4ed208&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=8f3f7f63a59d41099278b8a851d40286 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:59.698421 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a623a0d-db8f-4ccf-8117-9d61dfd4bce4 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:59.698977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a623a0d-db8f-4ccf-8117-9d61dfd4bce4 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:59.698977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a623a0d-db8f-4ccf-8117-9d61dfd4bce4 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:59.700717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 261/523] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:39:59.705859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31bae7-792e-4a29-a1e4-fcf73245efb3 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:59.706237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31bae7-792e-4a29-a1e4-fcf73245efb3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:59.706430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31bae7-792e-4a29-a1e4-fcf73245efb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:59.729815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1b31bae7-792e-4a29-a1e4-fcf73245efb3 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:39:59.730957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1b31bae7-792e-4a29-a1e4-fcf73245efb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:39:59.737657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 263/524] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:39:59 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:39:59.761280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a623a0d-db8f-4ccf-8117-9d61dfd4bce4 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:59.772801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a623a0d-db8f-4ccf-8117-9d61dfd4bce4 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:59.777690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6632fe8-1bee-4f5f-9098-e448be6a268f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:59.778394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6632fe8-1bee-4f5f-9098-e448be6a268f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:59.778683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6632fe8-1bee-4f5f-9098-e448be6a268f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:59.778963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6632fe8-1bee-4f5f-9098-e448be6a268f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:59.790641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6632fe8-1bee-4f5f-9098-e448be6a268f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:59.817584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6632fe8-1bee-4f5f-9098-e448be6a268f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:59.834901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-d6632fe8-1bee-4f5f-9098-e448be6a268f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:39:59.836019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 262/525] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:39:59.842728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31bae7-792e-4a29-a1e4-fcf73245efb3 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:59.851222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31bae7-792e-4a29-a1e4-fcf73245efb3 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:59.856083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c1d32-36ac-405e-bb7c-0ba99123870e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:59.856659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c1d32-36ac-405e-bb7c-0ba99123870e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:59.856941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c1d32-36ac-405e-bb7c-0ba99123870e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:59.857219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c1d32-36ac-405e-bb7c-0ba99123870e admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:59.857891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c1d32-36ac-405e-bb7c-0ba99123870e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:39:59.858185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c1d32-36ac-405e-bb7c-0ba99123870e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:59.883913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c1d32-36ac-405e-bb7c-0ba99123870e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:39:59.896591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 264/526] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:39:59.902675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6632fe8-1bee-4f5f-9098-e448be6a268f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:39:59.912292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6632fe8-1bee-4f5f-9098-e448be6a268f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:39:59.916221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227150ab-2da4-46df-ba4a-0388236a5949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:39:59.917456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227150ab-2da4-46df-ba4a-0388236a5949 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:39:59.917743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227150ab-2da4-46df-ba4a-0388236a5949 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:39:59.918022 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227150ab-2da4-46df-ba4a-0388236a5949 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:39:59.918670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227150ab-2da4-46df-ba4a-0388236a5949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:39:59.944741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227150ab-2da4-46df-ba4a-0388236a5949 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:00.026854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 263/527] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:39:59 2022] POST /identity/v3/users => generated 248 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:40:02.049165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36b575-7802-4b7a-8252-49bf7cf0b38f None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.049746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36b575-7802-4b7a-8252-49bf7cf0b38f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.049746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36b575-7802-4b7a-8252-49bf7cf0b38f None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.051478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 265/528] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 12:40:02.057860 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732d3c-d071-4d78-a051-3bf1e4cb26b4 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.058302 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732d3c-d071-4d78-a051-3bf1e4cb26b4 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.058537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d732d3c-d071-4d78-a051-3bf1e4cb26b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.081685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4d732d3c-d071-4d78-a051-3bf1e4cb26b4 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:02.082837 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4d732d3c-d071-4d78-a051-3bf1e4cb26b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:02.090051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 264/529] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:02 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:40:02.112735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36b575-7802-4b7a-8252-49bf7cf0b38f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.124374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36b575-7802-4b7a-8252-49bf7cf0b38f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.128252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016321d-9b70-4952-9d4e-3407dda95714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.128964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016321d-9b70-4952-9d4e-3407dda95714 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.129251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016321d-9b70-4952-9d4e-3407dda95714 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.129530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d016321d-9b70-4952-9d4e-3407dda95714 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.140680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d016321d-9b70-4952-9d4e-3407dda95714 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:02.146925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-d016321d-9b70-4952-9d4e-3407dda95714 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:40:02.148067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 266/530] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:02.154829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732d3c-d071-4d78-a051-3bf1e4cb26b4 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.163747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d732d3c-d071-4d78-a051-3bf1e4cb26b4 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.168458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a7919-9d35-45ac-82ba-2e28cdf251dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.169050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a7919-9d35-45ac-82ba-2e28cdf251dc admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.169333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a7919-9d35-45ac-82ba-2e28cdf251dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.169609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a7919-9d35-45ac-82ba-2e28cdf251dc admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.170320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a7919-9d35-45ac-82ba-2e28cdf251dc admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:02.170613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a7919-9d35-45ac-82ba-2e28cdf251dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.195814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a7919-9d35-45ac-82ba-2e28cdf251dc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.205533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 265/531] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:02.211275 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016321d-9b70-4952-9d4e-3407dda95714 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.222191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d016321d-9b70-4952-9d4e-3407dda95714 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.226172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664374c-522d-422d-81fe-08dfbe76a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.226883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664374c-522d-422d-81fe-08dfbe76a344 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.227171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664374c-522d-422d-81fe-08dfbe76a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.227481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664374c-522d-422d-81fe-08dfbe76a344 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.239294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664374c-522d-422d-81fe-08dfbe76a344 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.265913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d664374c-522d-422d-81fe-08dfbe76a344 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.285390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-d664374c-522d-422d-81fe-08dfbe76a344 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:02.286515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 267/532] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:02.293244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a7919-9d35-45ac-82ba-2e28cdf251dc admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.302877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a7919-9d35-45ac-82ba-2e28cdf251dc admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.307424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc7e27-dcfd-4232-a00f-5bc2ed6602d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.308586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc7e27-dcfd-4232-a00f-5bc2ed6602d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.308880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc7e27-dcfd-4232-a00f-5bc2ed6602d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.309165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc7e27-dcfd-4232-a00f-5bc2ed6602d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.309869 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc7e27-dcfd-4232-a00f-5bc2ed6602d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:02.310172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc7e27-dcfd-4232-a00f-5bc2ed6602d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.335989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc7e27-dcfd-4232-a00f-5bc2ed6602d8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.350081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 266/533] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:02.356361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664374c-522d-422d-81fe-08dfbe76a344 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.365795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664374c-522d-422d-81fe-08dfbe76a344 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.370666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c68fc-b65c-45fe-9f9e-b11c392d18d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.371492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c68fc-b65c-45fe-9f9e-b11c392d18d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.371788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c68fc-b65c-45fe-9f9e-b11c392d18d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.372068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c68fc-b65c-45fe-9f9e-b11c392d18d5 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.385478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c68fc-b65c-45fe-9f9e-b11c392d18d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.411696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c68fc-b65c-45fe-9f9e-b11c392d18d5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.430886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-2b0c68fc-b65c-45fe-9f9e-b11c392d18d5 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 18 12:40:02.432686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 268/534] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:02.438515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc7e27-dcfd-4232-a00f-5bc2ed6602d8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.448575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc7e27-dcfd-4232-a00f-5bc2ed6602d8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.452723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ef723-a052-400c-80bf-a95b98eda447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.453336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ef723-a052-400c-80bf-a95b98eda447 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.453619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ef723-a052-400c-80bf-a95b98eda447 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.453897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ef723-a052-400c-80bf-a95b98eda447 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.454701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ef723-a052-400c-80bf-a95b98eda447 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:02.454998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ef723-a052-400c-80bf-a95b98eda447 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.480955 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ef723-a052-400c-80bf-a95b98eda447 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.519286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 267/535] 10.222.0.87 () {56 vars in 1158 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:02.525274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c68fc-b65c-45fe-9f9e-b11c392d18d5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.536055 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c68fc-b65c-45fe-9f9e-b11c392d18d5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.540146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb705a4-37c2-420c-b743-a28c2d1be0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.540710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb705a4-37c2-420c-b743-a28c2d1be0cb admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.540996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb705a4-37c2-420c-b743-a28c2d1be0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.541472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb705a4-37c2-420c-b743-a28c2d1be0cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.549615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb705a4-37c2-420c-b743-a28c2d1be0cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.576449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb705a4-37c2-420c-b743-a28c2d1be0cb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.585573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 269/536] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:40:02.592029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ef723-a052-400c-80bf-a95b98eda447 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.601730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ef723-a052-400c-80bf-a95b98eda447 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.606875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e9aab-110e-4305-b800-58fc816d3ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.607660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e9aab-110e-4305-b800-58fc816d3ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.607950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e9aab-110e-4305-b800-58fc816d3ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.608230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e9aab-110e-4305-b800-58fc816d3ac9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.621672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e9aab-110e-4305-b800-58fc816d3ac9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.647845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e9aab-110e-4305-b800-58fc816d3ac9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.667565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-302e9aab-110e-4305-b800-58fc816d3ac9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:02.668769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 268/537] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:02.674687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb705a4-37c2-420c-b743-a28c2d1be0cb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.684001 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb705a4-37c2-420c-b743-a28c2d1be0cb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.688268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df93985-ab1d-412a-a508-8d72dcd50060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.688856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df93985-ab1d-412a-a508-8d72dcd50060 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.689148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df93985-ab1d-412a-a508-8d72dcd50060 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.689435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df93985-ab1d-412a-a508-8d72dcd50060 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.690119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df93985-ab1d-412a-a508-8d72dcd50060 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:02.690421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df93985-ab1d-412a-a508-8d72dcd50060 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.717384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df93985-ab1d-412a-a508-8d72dcd50060 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.732127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 270/538] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:02.737805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e9aab-110e-4305-b800-58fc816d3ac9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.747147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e9aab-110e-4305-b800-58fc816d3ac9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.751052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8e54-7eec-4801-8587-e7f053c16197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.751869 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8e54-7eec-4801-8587-e7f053c16197 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.752074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8e54-7eec-4801-8587-e7f053c16197 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.752350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8e54-7eec-4801-8587-e7f053c16197 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.761417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf8e54-7eec-4801-8587-e7f053c16197 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.787906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf8e54-7eec-4801-8587-e7f053c16197 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.802805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-bccf8e54-7eec-4801-8587-e7f053c16197 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:02.803957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 269/539] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:02.810430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df93985-ab1d-412a-a508-8d72dcd50060 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.819853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df93985-ab1d-412a-a508-8d72dcd50060 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.824539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29e592-7a2e-467b-bc5a-28d71db850cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.825125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e592-7a2e-467b-bc5a-28d71db850cf admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.825417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e592-7a2e-467b-bc5a-28d71db850cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.825700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29e592-7a2e-467b-bc5a-28d71db850cf admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.826439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e592-7a2e-467b-bc5a-28d71db850cf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:02.826792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e592-7a2e-467b-bc5a-28d71db850cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.853049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29e592-7a2e-467b-bc5a-28d71db850cf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.867474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 271/540] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:02.874269 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8e54-7eec-4801-8587-e7f053c16197 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:02.883740 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8e54-7eec-4801-8587-e7f053c16197 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:02.888337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e3a884-b257-4f02-8ec1-ebad8205c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:02.888929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3a884-b257-4f02-8ec1-ebad8205c98c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:02.889211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3a884-b257-4f02-8ec1-ebad8205c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:02.889489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e3a884-b257-4f02-8ec1-ebad8205c98c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:02.890268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3a884-b257-4f02-8ec1-ebad8205c98c admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=1aecbdda2f524fbca580d99b3001bed4) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:02.890568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3a884-b257-4f02-8ec1-ebad8205c98c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:02.917055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e3a884-b257-4f02-8ec1-ebad8205c98c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:02.923181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 270/541] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:40:02 2022] GET /identity/v3/role_assignments?user.id=1aecbdda2f524fbca580d99b3001bed4&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:04.929092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff94bd-6032-4f0d-ba03-26e078f5879b None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:04.929623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff94bd-6032-4f0d-ba03-26e078f5879b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:04.929733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff94bd-6032-4f0d-ba03-26e078f5879b None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:04.931354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 272/542] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:04.937222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353d578-74c9-4fab-9a28-51fe649a9fb0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:04.937767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353d578-74c9-4fab-9a28-51fe649a9fb0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:04.937767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353d578-74c9-4fab-9a28-51fe649a9fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:04.970462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-a353d578-74c9-4fab-9a28-51fe649a9fb0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:04.971811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a353d578-74c9-4fab-9a28-51fe649a9fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:04.980042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 271/543] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:04 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:05.001861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff94bd-6032-4f0d-ba03-26e078f5879b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.014246 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff94bd-6032-4f0d-ba03-26e078f5879b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.018145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78494-74ac-4843-aa98-344b43f618ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.018893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78494-74ac-4843-aa98-344b43f618ad admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.019177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78494-74ac-4843-aa98-344b43f618ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.019492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee78494-74ac-4843-aa98-344b43f618ad admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.031886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee78494-74ac-4843-aa98-344b43f618ad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:05.038483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-2ee78494-74ac-4843-aa98-344b43f618ad admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:40:05.039674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 273/544] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:05.046541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353d578-74c9-4fab-9a28-51fe649a9fb0 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.055418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353d578-74c9-4fab-9a28-51fe649a9fb0 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.060705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba0a83-898d-4f2f-a830-4fbc5c75c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.061324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba0a83-898d-4f2f-a830-4fbc5c75c26c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.061613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba0a83-898d-4f2f-a830-4fbc5c75c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.061895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba0a83-898d-4f2f-a830-4fbc5c75c26c admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.062627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba0a83-898d-4f2f-a830-4fbc5c75c26c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:05.062931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba0a83-898d-4f2f-a830-4fbc5c75c26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.090125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba0a83-898d-4f2f-a830-4fbc5c75c26c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.099448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 272/545] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:05.105948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78494-74ac-4843-aa98-344b43f618ad admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.116022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee78494-74ac-4843-aa98-344b43f618ad admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.120172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00280fac-ec23-4a53-a4ac-6b72609d4207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.120889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00280fac-ec23-4a53-a4ac-6b72609d4207 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.121175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00280fac-ec23-4a53-a4ac-6b72609d4207 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.121455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00280fac-ec23-4a53-a4ac-6b72609d4207 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.133347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00280fac-ec23-4a53-a4ac-6b72609d4207 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.160365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00280fac-ec23-4a53-a4ac-6b72609d4207 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.179630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-00280fac-ec23-4a53-a4ac-6b72609d4207 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:05.180686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 274/546] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:05.186808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba0a83-898d-4f2f-a830-4fbc5c75c26c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.196228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba0a83-898d-4f2f-a830-4fbc5c75c26c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.201329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cc6a1-970f-46c9-aa6e-bb00332c2075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.201924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cc6a1-970f-46c9-aa6e-bb00332c2075 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.202215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cc6a1-970f-46c9-aa6e-bb00332c2075 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.202500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cc6a1-970f-46c9-aa6e-bb00332c2075 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.203259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cc6a1-970f-46c9-aa6e-bb00332c2075 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:05.203597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cc6a1-970f-46c9-aa6e-bb00332c2075 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.231904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730cc6a1-970f-46c9-aa6e-bb00332c2075 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.248566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 273/547] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:05.254830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00280fac-ec23-4a53-a4ac-6b72609d4207 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.266751 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00280fac-ec23-4a53-a4ac-6b72609d4207 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.271342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471858e-f77c-4da1-8d04-991b7553a59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.272142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471858e-f77c-4da1-8d04-991b7553a59e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.272436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471858e-f77c-4da1-8d04-991b7553a59e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.272720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471858e-f77c-4da1-8d04-991b7553a59e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.288687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471858e-f77c-4da1-8d04-991b7553a59e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.320522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471858e-f77c-4da1-8d04-991b7553a59e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.343205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-3471858e-f77c-4da1-8d04-991b7553a59e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 18 12:40:05.344514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 275/548] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:05.350317 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cc6a1-970f-46c9-aa6e-bb00332c2075 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.360898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cc6a1-970f-46c9-aa6e-bb00332c2075 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.365235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8c5a8-1e29-4d8c-94a3-fb3b61d9c8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.365833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8c5a8-1e29-4d8c-94a3-fb3b61d9c8ef admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.366121 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8c5a8-1e29-4d8c-94a3-fb3b61d9c8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.366406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8c5a8-1e29-4d8c-94a3-fb3b61d9c8ef admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.367207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8c5a8-1e29-4d8c-94a3-fb3b61d9c8ef admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:05.367541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8c5a8-1e29-4d8c-94a3-fb3b61d9c8ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.393608 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8c5a8-1e29-4d8c-94a3-fb3b61d9c8ef admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.425127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 274/549] 10.222.0.87 () {56 vars in 1158 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:05.431043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471858e-f77c-4da1-8d04-991b7553a59e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.441647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471858e-f77c-4da1-8d04-991b7553a59e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.446010 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060b782-768a-45dd-9279-804cd035cce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.446757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060b782-768a-45dd-9279-804cd035cce2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.447053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060b782-768a-45dd-9279-804cd035cce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.448234 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060b782-768a-45dd-9279-804cd035cce2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.462517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060b782-768a-45dd-9279-804cd035cce2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.489825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060b782-768a-45dd-9279-804cd035cce2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.508040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-7060b782-768a-45dd-9279-804cd035cce2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:05.509186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 276/550] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:05.515663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8c5a8-1e29-4d8c-94a3-fb3b61d9c8ef admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.526762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8c5a8-1e29-4d8c-94a3-fb3b61d9c8ef admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.530886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de99050-6c5b-493a-847f-e1fc471e398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.531528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de99050-6c5b-493a-847f-e1fc471e398e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.531817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de99050-6c5b-493a-847f-e1fc471e398e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.532102 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de99050-6c5b-493a-847f-e1fc471e398e admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.533061 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de99050-6c5b-493a-847f-e1fc471e398e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:05.533369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de99050-6c5b-493a-847f-e1fc471e398e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.560676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de99050-6c5b-493a-847f-e1fc471e398e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.574656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 275/551] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:05.580369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060b782-768a-45dd-9279-804cd035cce2 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.590324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060b782-768a-45dd-9279-804cd035cce2 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.594480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0fe01-b246-4053-83b6-420f83c8e5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.595204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0fe01-b246-4053-83b6-420f83c8e5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.595523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0fe01-b246-4053-83b6-420f83c8e5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.595809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0fe01-b246-4053-83b6-420f83c8e5a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.607601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0fe01-b246-4053-83b6-420f83c8e5a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.635436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0fe01-b246-4053-83b6-420f83c8e5a9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.651859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-93f0fe01-b246-4053-83b6-420f83c8e5a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:05.653046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 277/552] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:40:05.659290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de99050-6c5b-493a-847f-e1fc471e398e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.670841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de99050-6c5b-493a-847f-e1fc471e398e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.675131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ba9a9-2306-4306-a336-dbc4adc6b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.675786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ba9a9-2306-4306-a336-dbc4adc6b5ec admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.676978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ba9a9-2306-4306-a336-dbc4adc6b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.676978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ba9a9-2306-4306-a336-dbc4adc6b5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.682275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ba9a9-2306-4306-a336-dbc4adc6b5ec admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:05.682275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ba9a9-2306-4306-a336-dbc4adc6b5ec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.720799 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ba9a9-2306-4306-a336-dbc4adc6b5ec admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.743287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 276/553] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:05.752532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0fe01-b246-4053-83b6-420f83c8e5a9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:05.761997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0fe01-b246-4053-83b6-420f83c8e5a9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:05.766124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530c01-9a08-4378-8c25-a41bc6bc90ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:05.766940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530c01-9a08-4378-8c25-a41bc6bc90ce admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:05.767232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530c01-9a08-4378-8c25-a41bc6bc90ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:05.767548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530c01-9a08-4378-8c25-a41bc6bc90ce admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/1aecbdda2f524fbca580d99b3001bed4/roles/021156a7816c4a96874e0a699028ceef` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:05.789298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530c01-9a08-4378-8c25-a41bc6bc90ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=1aecbdda2f524fbca580d99b3001bed4, role_id=021156a7816c4a96874e0a699028ceef)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:05.816123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530c01-9a08-4378-8c25-a41bc6bc90ce admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:05.895292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 278/554] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:40:05 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/1aecbdda2f524fbca580d99b3001bed4/roles/021156a7816c4a96874e0a699028ceef => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 12:40:07.893050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc2e38-a38c-42b0-b631-5ade52ed028f None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:07.893574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc2e38-a38c-42b0-b631-5ade52ed028f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:07.893684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc2e38-a38c-42b0-b631-5ade52ed028f None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:07.895291 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 277/555] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:07.900803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd09a1-e072-477e-9329-bcbb5450cb6b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:07.901218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd09a1-e072-477e-9329-bcbb5450cb6b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:07.901393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd09a1-e072-477e-9329-bcbb5450cb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:07.924091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7dfd09a1-e072-477e-9329-bcbb5450cb6b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:07.925232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7dfd09a1-e072-477e-9329-bcbb5450cb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:07.988147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 279/556] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:07 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:40:08.011598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc2e38-a38c-42b0-b631-5ade52ed028f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.023285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc2e38-a38c-42b0-b631-5ade52ed028f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.027156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88429e-e9bc-48e7-ba2f-0101208c581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.027905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88429e-e9bc-48e7-ba2f-0101208c581a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.028193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88429e-e9bc-48e7-ba2f-0101208c581a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.028471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88429e-e9bc-48e7-ba2f-0101208c581a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.039832 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88429e-e9bc-48e7-ba2f-0101208c581a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:08.046188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-ae88429e-e9bc-48e7-ba2f-0101208c581a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:40:08.047354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 278/557] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:08.053524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd09a1-e072-477e-9329-bcbb5450cb6b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.062790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd09a1-e072-477e-9329-bcbb5450cb6b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.066741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c2cd-19f9-47e8-801f-d3404ace572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.067374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c2cd-19f9-47e8-801f-d3404ace572e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.067667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c2cd-19f9-47e8-801f-d3404ace572e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.067948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c2cd-19f9-47e8-801f-d3404ace572e admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.070597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c2cd-19f9-47e8-801f-d3404ace572e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:08.070597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c2cd-19f9-47e8-801f-d3404ace572e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.095617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c2cd-19f9-47e8-801f-d3404ace572e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.104994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 280/558] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:08.110614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88429e-e9bc-48e7-ba2f-0101208c581a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.123089 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88429e-e9bc-48e7-ba2f-0101208c581a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.127155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408f7a8-d011-4d6e-b6de-01b3ca68bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.127895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f7a8-d011-4d6e-b6de-01b3ca68bed7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.128185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f7a8-d011-4d6e-b6de-01b3ca68bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.128464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f7a8-d011-4d6e-b6de-01b3ca68bed7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.140235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408f7a8-d011-4d6e-b6de-01b3ca68bed7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.166632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408f7a8-d011-4d6e-b6de-01b3ca68bed7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.184722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-6408f7a8-d011-4d6e-b6de-01b3ca68bed7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:08.185788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 279/559] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:40:08.191291 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c2cd-19f9-47e8-801f-d3404ace572e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.201128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c2cd-19f9-47e8-801f-d3404ace572e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.205112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256587a0-6c11-4dd0-8415-0c6305c59149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.205715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256587a0-6c11-4dd0-8415-0c6305c59149 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.206007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256587a0-6c11-4dd0-8415-0c6305c59149 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.206292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256587a0-6c11-4dd0-8415-0c6305c59149 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.206972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256587a0-6c11-4dd0-8415-0c6305c59149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:08.207276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256587a0-6c11-4dd0-8415-0c6305c59149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.234138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256587a0-6c11-4dd0-8415-0c6305c59149 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.248228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 281/560] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:08.253625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408f7a8-d011-4d6e-b6de-01b3ca68bed7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.263263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408f7a8-d011-4d6e-b6de-01b3ca68bed7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.267287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe24a2-6d25-4df6-939b-de93ad6560eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.268023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe24a2-6d25-4df6-939b-de93ad6560eb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.268351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe24a2-6d25-4df6-939b-de93ad6560eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.268632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe24a2-6d25-4df6-939b-de93ad6560eb admin admin] PATH_INFO: `/v3/users/glance` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.281150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe24a2-6d25-4df6-939b-de93ad6560eb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.308431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe24a2-6d25-4df6-939b-de93ad6560eb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.334575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-41fe24a2-6d25-4df6-939b-de93ad6560eb admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 18 12:40:08.335750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 280/561] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:08.341789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256587a0-6c11-4dd0-8415-0c6305c59149 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.351013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256587a0-6c11-4dd0-8415-0c6305c59149 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.356047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f0a14-ffd9-4388-b616-e6ab31f932eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.356637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f0a14-ffd9-4388-b616-e6ab31f932eb admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.356925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f0a14-ffd9-4388-b616-e6ab31f932eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.357206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f0a14-ffd9-4388-b616-e6ab31f932eb admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.357983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f0a14-ffd9-4388-b616-e6ab31f932eb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:08.358286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f0a14-ffd9-4388-b616-e6ab31f932eb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.384609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f0a14-ffd9-4388-b616-e6ab31f932eb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.413228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 282/562] 10.222.0.87 () {56 vars in 1158 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:08.419471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe24a2-6d25-4df6-939b-de93ad6560eb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.428589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe24a2-6d25-4df6-939b-de93ad6560eb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.433451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b49a5-3d01-45d0-aac1-d3647573a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.434049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b49a5-3d01-45d0-aac1-d3647573a48e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.434340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b49a5-3d01-45d0-aac1-d3647573a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.434623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b49a5-3d01-45d0-aac1-d3647573a48e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.442254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b49a5-3d01-45d0-aac1-d3647573a48e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.468235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b49a5-3d01-45d0-aac1-d3647573a48e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.477101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 281/563] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:40:08.483554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f0a14-ffd9-4388-b616-e6ab31f932eb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.492852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f0a14-ffd9-4388-b616-e6ab31f932eb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.498183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d210-3a19-486e-a592-0ffd807492a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.498908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d210-3a19-486e-a592-0ffd807492a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.499201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d210-3a19-486e-a592-0ffd807492a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.499516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700d210-3a19-486e-a592-0ffd807492a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.512073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700d210-3a19-486e-a592-0ffd807492a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.538829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700d210-3a19-486e-a592-0ffd807492a8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.556138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-c700d210-3a19-486e-a592-0ffd807492a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:08.558313 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 283/564] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:08.563995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b49a5-3d01-45d0-aac1-d3647573a48e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.573372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b49a5-3d01-45d0-aac1-d3647573a48e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.577449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1bd31-6b10-4e19-a43e-ccf4948db84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.578031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1bd31-6b10-4e19-a43e-ccf4948db84f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.578318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1bd31-6b10-4e19-a43e-ccf4948db84f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.578602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1bd31-6b10-4e19-a43e-ccf4948db84f admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.579279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1bd31-6b10-4e19-a43e-ccf4948db84f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:08.579611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1bd31-6b10-4e19-a43e-ccf4948db84f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.605165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1bd31-6b10-4e19-a43e-ccf4948db84f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.619436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 282/565] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:08.625218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d210-3a19-486e-a592-0ffd807492a8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.635208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700d210-3a19-486e-a592-0ffd807492a8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.639582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dce51e-ca61-4eb1-867a-18d808b0450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.641874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dce51e-ca61-4eb1-867a-18d808b0450d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.641874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dce51e-ca61-4eb1-867a-18d808b0450d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.641874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dce51e-ca61-4eb1-867a-18d808b0450d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.649793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dce51e-ca61-4eb1-867a-18d808b0450d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.676344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dce51e-ca61-4eb1-867a-18d808b0450d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.690601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-b4dce51e-ca61-4eb1-867a-18d808b0450d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:08.691767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 284/566] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:08.697576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1bd31-6b10-4e19-a43e-ccf4948db84f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.707593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1bd31-6b10-4e19-a43e-ccf4948db84f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.711603 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a159e4c-f3a1-4799-9995-746eb94a79a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.712180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a159e4c-f3a1-4799-9995-746eb94a79a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.712464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a159e4c-f3a1-4799-9995-746eb94a79a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.712966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a159e4c-f3a1-4799-9995-746eb94a79a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.713722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a159e4c-f3a1-4799-9995-746eb94a79a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:08.714021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a159e4c-f3a1-4799-9995-746eb94a79a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.739353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a159e4c-f3a1-4799-9995-746eb94a79a5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.753550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 283/567] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:08.759559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dce51e-ca61-4eb1-867a-18d808b0450d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:08.769190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dce51e-ca61-4eb1-867a-18d808b0450d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:08.773192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6121e4-c14e-4f5a-b219-2bc14a584c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:08.773753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6121e4-c14e-4f5a-b219-2bc14a584c84 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:08.774038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6121e4-c14e-4f5a-b219-2bc14a584c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:08.774318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6121e4-c14e-4f5a-b219-2bc14a584c84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:08.775076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6121e4-c14e-4f5a-b219-2bc14a584c84 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=1aecbdda2f524fbca580d99b3001bed4) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:08.775458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6121e4-c14e-4f5a-b219-2bc14a584c84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:08.801241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6121e4-c14e-4f5a-b219-2bc14a584c84 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:08.807625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 285/568] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:40:08 2022] GET /identity/v3/role_assignments?user.id=1aecbdda2f524fbca580d99b3001bed4&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:10.912585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e834c6-8671-4297-be04-1e40fce793f3 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:10.913221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e834c6-8671-4297-be04-1e40fce793f3 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:10.913221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e834c6-8671-4297-be04-1e40fce793f3 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:10.914832 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 284/569] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:10.920632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed0ec8-c03d-403b-8a35-d9d99922be53 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:10.921065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed0ec8-c03d-403b-8a35-d9d99922be53 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:10.921201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed0ec8-c03d-403b-8a35-d9d99922be53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:10.944331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-66ed0ec8-c03d-403b-8a35-d9d99922be53 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:10.945469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-66ed0ec8-c03d-403b-8a35-d9d99922be53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:10.953168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 286/570] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:10 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:10.977127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e834c6-8671-4297-be04-1e40fce793f3 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:10.988923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e834c6-8671-4297-be04-1e40fce793f3 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:10.992800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64f9ec-aa58-4ea2-9da7-1557d10f2ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:10.993508 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64f9ec-aa58-4ea2-9da7-1557d10f2ece admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:10.994311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64f9ec-aa58-4ea2-9da7-1557d10f2ece admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:10.994598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64f9ec-aa58-4ea2-9da7-1557d10f2ece admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:11.005903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64f9ec-aa58-4ea2-9da7-1557d10f2ece admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:11.032133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64f9ec-aa58-4ea2-9da7-1557d10f2ece admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:11.051769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-bb64f9ec-aa58-4ea2-9da7-1557d10f2ece admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:11.052904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 285/571] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:11.059842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed0ec8-c03d-403b-8a35-d9d99922be53 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:11.068526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed0ec8-c03d-403b-8a35-d9d99922be53 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:11.073307 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d117-d1c0-4974-901a-4f27745d27ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:11.073889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d117-d1c0-4974-901a-4f27745d27ee admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:11.074192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d117-d1c0-4974-901a-4f27745d27ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:11.074466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d117-d1c0-4974-901a-4f27745d27ee admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:11.075147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79d117-d1c0-4974-901a-4f27745d27ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:11.075489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79d117-d1c0-4974-901a-4f27745d27ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:11.100684 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79d117-d1c0-4974-901a-4f27745d27ee admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:11.113903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 287/572] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:11.120139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64f9ec-aa58-4ea2-9da7-1557d10f2ece admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:11.129573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64f9ec-aa58-4ea2-9da7-1557d10f2ece admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:11.133565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe36cb5-6eb9-44b8-b9d6-cd41ea7d248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:11.134155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe36cb5-6eb9-44b8-b9d6-cd41ea7d248e admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:11.135108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe36cb5-6eb9-44b8-b9d6-cd41ea7d248e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:11.135455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe36cb5-6eb9-44b8-b9d6-cd41ea7d248e admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:11.136219 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe36cb5-6eb9-44b8-b9d6-cd41ea7d248e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:11.176647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe36cb5-6eb9-44b8-b9d6-cd41ea7d248e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:11.292966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 286/573] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:40:11 2022] POST /identity/v3/users => generated 254 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:40:13.293145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e529-0e70-48f8-8e74-0fa4474959ab None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.293685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e529-0e70-48f8-8e74-0fa4474959ab None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.293685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e529-0e70-48f8-8e74-0fa4474959ab None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.295450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 288/574] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:13.300614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be75687-4e2c-47c7-bf4c-bc39dcb11241 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.301036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be75687-4e2c-47c7-bf4c-bc39dcb11241 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.301177 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be75687-4e2c-47c7-bf4c-bc39dcb11241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.324103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4be75687-4e2c-47c7-bf4c-bc39dcb11241 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:13.325234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4be75687-4e2c-47c7-bf4c-bc39dcb11241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:13.331905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 287/575] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:13 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:13.353786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e529-0e70-48f8-8e74-0fa4474959ab None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.366308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e529-0e70-48f8-8e74-0fa4474959ab None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.370803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f99be4-1678-4711-820c-8532c2c5df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.371550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f99be4-1678-4711-820c-8532c2c5df05 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.371841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f99be4-1678-4711-820c-8532c2c5df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.372121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f99be4-1678-4711-820c-8532c2c5df05 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.383142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f99be4-1678-4711-820c-8532c2c5df05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:13.390310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-12f99be4-1678-4711-820c-8532c2c5df05 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:40:13.391413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 289/576] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:13.397605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be75687-4e2c-47c7-bf4c-bc39dcb11241 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.406309 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be75687-4e2c-47c7-bf4c-bc39dcb11241 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.410486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dea16-6197-4637-b2bc-c37b8d68859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.411077 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dea16-6197-4637-b2bc-c37b8d68859e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.411430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dea16-6197-4637-b2bc-c37b8d68859e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.411713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dea16-6197-4637-b2bc-c37b8d68859e admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.412423 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dea16-6197-4637-b2bc-c37b8d68859e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:13.412718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dea16-6197-4637-b2bc-c37b8d68859e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:13.439597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dea16-6197-4637-b2bc-c37b8d68859e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:13.448400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 288/577] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:13.453949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f99be4-1678-4711-820c-8532c2c5df05 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.465523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f99be4-1678-4711-820c-8532c2c5df05 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.469941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b792e8-dc5e-44e3-8353-683cd0f59f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.470647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b792e8-dc5e-44e3-8353-683cd0f59f04 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.470931 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b792e8-dc5e-44e3-8353-683cd0f59f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.471212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b792e8-dc5e-44e3-8353-683cd0f59f04 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.482880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b792e8-dc5e-44e3-8353-683cd0f59f04 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:13.509196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b792e8-dc5e-44e3-8353-683cd0f59f04 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:13.528564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-18b792e8-dc5e-44e3-8353-683cd0f59f04 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:13.529697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 290/578] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:13.536220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dea16-6197-4637-b2bc-c37b8d68859e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.546433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dea16-6197-4637-b2bc-c37b8d68859e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.550463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ceaca-8dcd-4a0d-b8f6-b9b5f29bf5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.551043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ceaca-8dcd-4a0d-b8f6-b9b5f29bf5fb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.551356 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ceaca-8dcd-4a0d-b8f6-b9b5f29bf5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.551641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ceaca-8dcd-4a0d-b8f6-b9b5f29bf5fb admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.552322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ceaca-8dcd-4a0d-b8f6-b9b5f29bf5fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:13.552622 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ceaca-8dcd-4a0d-b8f6-b9b5f29bf5fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:13.578922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ceaca-8dcd-4a0d-b8f6-b9b5f29bf5fb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:13.592172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 289/579] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:13.597724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b792e8-dc5e-44e3-8353-683cd0f59f04 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.607828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b792e8-dc5e-44e3-8353-683cd0f59f04 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.611765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dac47-522a-46e7-b99b-ab2a1988e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.612492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dac47-522a-46e7-b99b-ab2a1988e435 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.612780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dac47-522a-46e7-b99b-ab2a1988e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.613061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7dac47-522a-46e7-b99b-ab2a1988e435 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.626276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dac47-522a-46e7-b99b-ab2a1988e435 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:13.652025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7dac47-522a-46e7-b99b-ab2a1988e435 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:13.670665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-cc7dac47-522a-46e7-b99b-ab2a1988e435 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 18 12:40:13.671798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 291/580] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:13.677475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ceaca-8dcd-4a0d-b8f6-b9b5f29bf5fb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.688393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ceaca-8dcd-4a0d-b8f6-b9b5f29bf5fb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.692333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69845901-f5fe-414b-9256-c67a84ae059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.692920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69845901-f5fe-414b-9256-c67a84ae059f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.693204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69845901-f5fe-414b-9256-c67a84ae059f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.693483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69845901-f5fe-414b-9256-c67a84ae059f admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.694320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69845901-f5fe-414b-9256-c67a84ae059f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:13.694641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69845901-f5fe-414b-9256-c67a84ae059f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:13.720437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69845901-f5fe-414b-9256-c67a84ae059f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:13.750406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 290/581] 10.222.0.87 () {56 vars in 1170 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:13.755968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dac47-522a-46e7-b99b-ab2a1988e435 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.765302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7dac47-522a-46e7-b99b-ab2a1988e435 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.769205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e44ff-b09b-43f5-9fce-f087cc61d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.769763 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e44ff-b09b-43f5-9fce-f087cc61d531 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.770049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e44ff-b09b-43f5-9fce-f087cc61d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.770332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e44ff-b09b-43f5-9fce-f087cc61d531 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.777805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e44ff-b09b-43f5-9fce-f087cc61d531 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:13.803911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e44ff-b09b-43f5-9fce-f087cc61d531 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:13.813301 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 292/582] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:40:13.818847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69845901-f5fe-414b-9256-c67a84ae059f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.828289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69845901-f5fe-414b-9256-c67a84ae059f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.832198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812829f-ac45-4ca5-9a62-5bd7f05d6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.832915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812829f-ac45-4ca5-9a62-5bd7f05d6830 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.833198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812829f-ac45-4ca5-9a62-5bd7f05d6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.833477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812829f-ac45-4ca5-9a62-5bd7f05d6830 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.846616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812829f-ac45-4ca5-9a62-5bd7f05d6830 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:13.877007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812829f-ac45-4ca5-9a62-5bd7f05d6830 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:13.894525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-6812829f-ac45-4ca5-9a62-5bd7f05d6830 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:13.895665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 291/583] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:13.902035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e44ff-b09b-43f5-9fce-f087cc61d531 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.910775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e44ff-b09b-43f5-9fce-f087cc61d531 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.914862 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf3564-0d34-4f55-8713-c24b75798215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.915486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf3564-0d34-4f55-8713-c24b75798215 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.916477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf3564-0d34-4f55-8713-c24b75798215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.916858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf3564-0d34-4f55-8713-c24b75798215 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.917565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf3564-0d34-4f55-8713-c24b75798215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:13.917865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf3564-0d34-4f55-8713-c24b75798215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:13.943095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf3564-0d34-4f55-8713-c24b75798215 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:13.955982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 293/584] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:13.961402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812829f-ac45-4ca5-9a62-5bd7f05d6830 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:13.971292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812829f-ac45-4ca5-9a62-5bd7f05d6830 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:13.975269 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9936-89fb-4bdc-b68f-19ba1817c4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:13.976005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9936-89fb-4bdc-b68f-19ba1817c4df admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:13.976290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9936-89fb-4bdc-b68f-19ba1817c4df admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:13.976568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f9936-89fb-4bdc-b68f-19ba1817c4df admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:13.987480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9936-89fb-4bdc-b68f-19ba1817c4df admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:14.013188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f9936-89fb-4bdc-b68f-19ba1817c4df admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:14.027795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-c47f9936-89fb-4bdc-b68f-19ba1817c4df admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:14.028908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 292/585] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:14.034984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf3564-0d34-4f55-8713-c24b75798215 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:14.044972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf3564-0d34-4f55-8713-c24b75798215 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:14.048953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73efbf5-f757-4dcb-b991-0a3d6f36ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:14.049523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73efbf5-f757-4dcb-b991-0a3d6f36ec8d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:14.049809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73efbf5-f757-4dcb-b991-0a3d6f36ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:14.050087 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73efbf5-f757-4dcb-b991-0a3d6f36ec8d admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:14.050815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73efbf5-f757-4dcb-b991-0a3d6f36ec8d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:14.051110 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73efbf5-f757-4dcb-b991-0a3d6f36ec8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:14.076326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73efbf5-f757-4dcb-b991-0a3d6f36ec8d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:14.089940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 294/586] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:14.095685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9936-89fb-4bdc-b68f-19ba1817c4df admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:14.105640 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f9936-89fb-4bdc-b68f-19ba1817c4df admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:14.109694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c49961-67c7-44ae-b68f-fcc8cdb3eba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:14.110261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49961-67c7-44ae-b68f-fcc8cdb3eba1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:14.110545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49961-67c7-44ae-b68f-fcc8cdb3eba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:14.110820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49961-67c7-44ae-b68f-fcc8cdb3eba1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:14.111636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49961-67c7-44ae-b68f-fcc8cdb3eba1 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=54e44c49e9ac4ea5bfed707bc26d6cca) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:14.111941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49961-67c7-44ae-b68f-fcc8cdb3eba1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:14.137582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49961-67c7-44ae-b68f-fcc8cdb3eba1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:14.143822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 293/587] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:40:14 2022] GET /identity/v3/role_assignments?user.id=54e44c49e9ac4ea5bfed707bc26d6cca&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:16.147794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07cae3-3906-4b49-a237-6f8470bea2b3 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.148322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07cae3-3906-4b49-a237-6f8470bea2b3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.148427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07cae3-3906-4b49-a237-6f8470bea2b3 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.150565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 295/588] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:16.155688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3b683-889d-4ba7-a8b4-f8d7c96cf578 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.156118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3b683-889d-4ba7-a8b4-f8d7c96cf578 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.156262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3b683-889d-4ba7-a8b4-f8d7c96cf578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.179035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f1e3b683-889d-4ba7-a8b4-f8d7c96cf578 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:16.180197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f1e3b683-889d-4ba7-a8b4-f8d7c96cf578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:16.187834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 294/589] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:16 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:16.210466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07cae3-3906-4b49-a237-6f8470bea2b3 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.223085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07cae3-3906-4b49-a237-6f8470bea2b3 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.227005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ec309-7ca0-426b-adab-cb30921b6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.227745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ec309-7ca0-426b-adab-cb30921b6fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.228105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ec309-7ca0-426b-adab-cb30921b6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.228474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0ec309-7ca0-426b-adab-cb30921b6fd4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.239699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0ec309-7ca0-426b-adab-cb30921b6fd4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:16.246676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-1b0ec309-7ca0-426b-adab-cb30921b6fd4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:40:16.247810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 296/590] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:16.253722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3b683-889d-4ba7-a8b4-f8d7c96cf578 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.262971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3b683-889d-4ba7-a8b4-f8d7c96cf578 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.266976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3232e30-4036-4dc8-b166-b1a783011c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.267593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232e30-4036-4dc8-b166-b1a783011c3e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.267881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232e30-4036-4dc8-b166-b1a783011c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.268173 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232e30-4036-4dc8-b166-b1a783011c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.268981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232e30-4036-4dc8-b166-b1a783011c3e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:16.269324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232e30-4036-4dc8-b166-b1a783011c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.295164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232e30-4036-4dc8-b166-b1a783011c3e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:16.303937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 295/591] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:16.310438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ec309-7ca0-426b-adab-cb30921b6fd4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.320457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0ec309-7ca0-426b-adab-cb30921b6fd4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.325696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076edf12-6627-49e8-af51-4daa63a95ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.326393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076edf12-6627-49e8-af51-4daa63a95ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.326679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076edf12-6627-49e8-af51-4daa63a95ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.326954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076edf12-6627-49e8-af51-4daa63a95ad3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.338277 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076edf12-6627-49e8-af51-4daa63a95ad3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.364114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076edf12-6627-49e8-af51-4daa63a95ad3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:16.382374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-076edf12-6627-49e8-af51-4daa63a95ad3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:16.383457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 297/592] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:16.390595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3232e30-4036-4dc8-b166-b1a783011c3e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.405040 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3232e30-4036-4dc8-b166-b1a783011c3e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.409368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27610c22-9142-4134-a347-7c77a75f123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.409950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27610c22-9142-4134-a347-7c77a75f123b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.410238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27610c22-9142-4134-a347-7c77a75f123b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.410521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27610c22-9142-4134-a347-7c77a75f123b admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.411206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27610c22-9142-4134-a347-7c77a75f123b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:16.411543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27610c22-9142-4134-a347-7c77a75f123b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.438068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27610c22-9142-4134-a347-7c77a75f123b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:16.450979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 296/593] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:16.456413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076edf12-6627-49e8-af51-4daa63a95ad3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.465739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076edf12-6627-49e8-af51-4daa63a95ad3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.470395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113d57-4a49-48fd-8e9c-80cbe6407bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.471406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113d57-4a49-48fd-8e9c-80cbe6407bbe admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.471698 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113d57-4a49-48fd-8e9c-80cbe6407bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.471977 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04113d57-4a49-48fd-8e9c-80cbe6407bbe admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.486373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04113d57-4a49-48fd-8e9c-80cbe6407bbe admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.512820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04113d57-4a49-48fd-8e9c-80cbe6407bbe admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:16.531419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-04113d57-4a49-48fd-8e9c-80cbe6407bbe admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 18 12:40:16.532782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 298/594] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:16.538371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27610c22-9142-4134-a347-7c77a75f123b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.548351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27610c22-9142-4134-a347-7c77a75f123b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.552489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea7ff0-9ab8-49d9-af1e-9b5421432de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.553089 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea7ff0-9ab8-49d9-af1e-9b5421432de6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.553375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea7ff0-9ab8-49d9-af1e-9b5421432de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.553695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea7ff0-9ab8-49d9-af1e-9b5421432de6 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.554491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea7ff0-9ab8-49d9-af1e-9b5421432de6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:16.554795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea7ff0-9ab8-49d9-af1e-9b5421432de6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.581178 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea7ff0-9ab8-49d9-af1e-9b5421432de6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:16.610239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 297/595] 10.222.0.87 () {56 vars in 1170 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:16.615647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113d57-4a49-48fd-8e9c-80cbe6407bbe admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.625628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04113d57-4a49-48fd-8e9c-80cbe6407bbe admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.629733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7e3c4-f41b-498c-bafc-3c17f1943ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.630444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7e3c4-f41b-498c-bafc-3c17f1943ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.630735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7e3c4-f41b-498c-bafc-3c17f1943ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.631020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7e3c4-f41b-498c-bafc-3c17f1943ed3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.643109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7e3c4-f41b-498c-bafc-3c17f1943ed3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.669481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7e3c4-f41b-498c-bafc-3c17f1943ed3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:16.687563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-e4c7e3c4-f41b-498c-bafc-3c17f1943ed3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:16.688675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 299/596] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:16.694169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea7ff0-9ab8-49d9-af1e-9b5421432de6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.703965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea7ff0-9ab8-49d9-af1e-9b5421432de6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.708147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4202f-4ea1-4557-8b1c-d6f975f0ec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.708737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4202f-4ea1-4557-8b1c-d6f975f0ec3b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.709025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4202f-4ea1-4557-8b1c-d6f975f0ec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.709308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4202f-4ea1-4557-8b1c-d6f975f0ec3b admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.709998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4202f-4ea1-4557-8b1c-d6f975f0ec3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:16.710302 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4202f-4ea1-4557-8b1c-d6f975f0ec3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.736400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4202f-4ea1-4557-8b1c-d6f975f0ec3b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:16.749524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 298/597] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:16.754979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7e3c4-f41b-498c-bafc-3c17f1943ed3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.764325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7e3c4-f41b-498c-bafc-3c17f1943ed3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.768500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4713b-52b5-45a6-999b-11ad348240cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.769211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4713b-52b5-45a6-999b-11ad348240cb admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.769498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4713b-52b5-45a6-999b-11ad348240cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.769778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4713b-52b5-45a6-999b-11ad348240cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.779009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4713b-52b5-45a6-999b-11ad348240cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.805618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4713b-52b5-45a6-999b-11ad348240cb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:16.819850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-17f4713b-52b5-45a6-999b-11ad348240cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:16.820921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 300/598] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:16.826765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4202f-4ea1-4557-8b1c-d6f975f0ec3b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.836048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4202f-4ea1-4557-8b1c-d6f975f0ec3b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.840814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a4669-14d6-48a1-bdd9-9d2cb15704a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.841393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a4669-14d6-48a1-bdd9-9d2cb15704a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.841682 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a4669-14d6-48a1-bdd9-9d2cb15704a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.841966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a4669-14d6-48a1-bdd9-9d2cb15704a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.842741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a4669-14d6-48a1-bdd9-9d2cb15704a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:16.843047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a4669-14d6-48a1-bdd9-9d2cb15704a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.869090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a4669-14d6-48a1-bdd9-9d2cb15704a9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:16.881868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 299/599] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:16.887955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4713b-52b5-45a6-999b-11ad348240cb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:16.897140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4713b-52b5-45a6-999b-11ad348240cb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:16.901675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981de584-6aeb-492d-98c9-27798836f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:16.902479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de584-6aeb-492d-98c9-27798836f788 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:16.902769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de584-6aeb-492d-98c9-27798836f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:16.903054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981de584-6aeb-492d-98c9-27798836f788 admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/54e44c49e9ac4ea5bfed707bc26d6cca/roles/021156a7816c4a96874e0a699028ceef` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:16.923673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de584-6aeb-492d-98c9-27798836f788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=54e44c49e9ac4ea5bfed707bc26d6cca, role_id=021156a7816c4a96874e0a699028ceef)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:16.949977 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981de584-6aeb-492d-98c9-27798836f788 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:17.048806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 301/600] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:40:16 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/54e44c49e9ac4ea5bfed707bc26d6cca/roles/021156a7816c4a96874e0a699028ceef => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:40:19.066192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976de124-e86c-4f5d-9bad-d008c08f35f6 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.066746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976de124-e86c-4f5d-9bad-d008c08f35f6 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.066746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976de124-e86c-4f5d-9bad-d008c08f35f6 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.068489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 300/601] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:19.074681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0d507-d317-47dc-a78b-bc9461e65c7b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.075079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0d507-d317-47dc-a78b-bc9461e65c7b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.075398 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0d507-d317-47dc-a78b-bc9461e65c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.099817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-91f0d507-d317-47dc-a78b-bc9461e65c7b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:19.101490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-91f0d507-d317-47dc-a78b-bc9461e65c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:19.181341 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 302/602] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:19 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:19.204588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976de124-e86c-4f5d-9bad-d008c08f35f6 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.216552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976de124-e86c-4f5d-9bad-d008c08f35f6 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.220419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582b35-8bad-4ceb-80cc-48db47241427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.221134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582b35-8bad-4ceb-80cc-48db47241427 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.221425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582b35-8bad-4ceb-80cc-48db47241427 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.221709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c582b35-8bad-4ceb-80cc-48db47241427 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.232791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c582b35-8bad-4ceb-80cc-48db47241427 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:19.239146 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-2c582b35-8bad-4ceb-80cc-48db47241427 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:40:19.240264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 301/603] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:19.246889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0d507-d317-47dc-a78b-bc9461e65c7b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.255498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0d507-d317-47dc-a78b-bc9461e65c7b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.260133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c289714-4624-4717-8ec7-d70dc178fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.260717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c289714-4624-4717-8ec7-d70dc178fd9d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.261005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c289714-4624-4717-8ec7-d70dc178fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.261287 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c289714-4624-4717-8ec7-d70dc178fd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.261995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c289714-4624-4717-8ec7-d70dc178fd9d admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:19.262291 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c289714-4624-4717-8ec7-d70dc178fd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.287808 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c289714-4624-4717-8ec7-d70dc178fd9d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.296530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 303/604] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:19.302082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582b35-8bad-4ceb-80cc-48db47241427 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.312652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c582b35-8bad-4ceb-80cc-48db47241427 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.316708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32e60e-e00d-4eb8-82dd-b45648d87169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.317363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32e60e-e00d-4eb8-82dd-b45648d87169 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.317650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32e60e-e00d-4eb8-82dd-b45648d87169 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.317932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32e60e-e00d-4eb8-82dd-b45648d87169 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.329835 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32e60e-e00d-4eb8-82dd-b45648d87169 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.355988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32e60e-e00d-4eb8-82dd-b45648d87169 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.373823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-1e32e60e-e00d-4eb8-82dd-b45648d87169 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:19.374890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 302/605] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:19.380556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c289714-4624-4717-8ec7-d70dc178fd9d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.390984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c289714-4624-4717-8ec7-d70dc178fd9d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.394998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435f2b-62b7-4420-9683-c61ebfd3899a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.395681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435f2b-62b7-4420-9683-c61ebfd3899a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.395973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435f2b-62b7-4420-9683-c61ebfd3899a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.396260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435f2b-62b7-4420-9683-c61ebfd3899a admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.396938 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f435f2b-62b7-4420-9683-c61ebfd3899a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:19.397240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f435f2b-62b7-4420-9683-c61ebfd3899a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.424018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f435f2b-62b7-4420-9683-c61ebfd3899a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.437573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 304/606] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:19.443036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32e60e-e00d-4eb8-82dd-b45648d87169 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.452727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32e60e-e00d-4eb8-82dd-b45648d87169 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.456802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebea0e-a66c-41a8-8b2d-00eaf0da140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.457532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebea0e-a66c-41a8-8b2d-00eaf0da140e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.457822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebea0e-a66c-41a8-8b2d-00eaf0da140e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.458105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebea0e-a66c-41a8-8b2d-00eaf0da140e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.478207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebea0e-a66c-41a8-8b2d-00eaf0da140e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.513977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebea0e-a66c-41a8-8b2d-00eaf0da140e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.533618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-f3ebea0e-a66c-41a8-8b2d-00eaf0da140e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 18 12:40:19.534729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 303/607] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:19.541076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435f2b-62b7-4420-9683-c61ebfd3899a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.550670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435f2b-62b7-4420-9683-c61ebfd3899a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.554711 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b829d-134b-471e-acd0-9ad533b209c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.555297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b829d-134b-471e-acd0-9ad533b209c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.555619 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b829d-134b-471e-acd0-9ad533b209c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.556550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b829d-134b-471e-acd0-9ad533b209c4 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.557331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b829d-134b-471e-acd0-9ad533b209c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:19.557634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b829d-134b-471e-acd0-9ad533b209c4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.583117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b829d-134b-471e-acd0-9ad533b209c4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.612243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 305/608] 10.222.0.87 () {56 vars in 1170 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:19.617876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebea0e-a66c-41a8-8b2d-00eaf0da140e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.627721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebea0e-a66c-41a8-8b2d-00eaf0da140e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.631773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779aa00-6144-484a-b2a9-89c3da915af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.632329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779aa00-6144-484a-b2a9-89c3da915af4 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.632611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779aa00-6144-484a-b2a9-89c3da915af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.632885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779aa00-6144-484a-b2a9-89c3da915af4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.640962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779aa00-6144-484a-b2a9-89c3da915af4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.667484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779aa00-6144-484a-b2a9-89c3da915af4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.675803 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 304/609] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:40:19.681217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b829d-134b-471e-acd0-9ad533b209c4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.690422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b829d-134b-471e-acd0-9ad533b209c4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.694505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c3004-0cd3-4b6e-8322-097eb8d03d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.695212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c3004-0cd3-4b6e-8322-097eb8d03d3f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.695542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c3004-0cd3-4b6e-8322-097eb8d03d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.695826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c3004-0cd3-4b6e-8322-097eb8d03d3f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.708262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c3004-0cd3-4b6e-8322-097eb8d03d3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.734747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c3004-0cd3-4b6e-8322-097eb8d03d3f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.751330 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-a04c3004-0cd3-4b6e-8322-097eb8d03d3f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:19.752412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 306/610] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:19.758010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779aa00-6144-484a-b2a9-89c3da915af4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.767063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779aa00-6144-484a-b2a9-89c3da915af4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.771025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489c728-42b5-48dd-9d60-ff5eb56e6763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.771633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489c728-42b5-48dd-9d60-ff5eb56e6763 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.771914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489c728-42b5-48dd-9d60-ff5eb56e6763 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.772189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489c728-42b5-48dd-9d60-ff5eb56e6763 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.772858 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489c728-42b5-48dd-9d60-ff5eb56e6763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:19.773151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489c728-42b5-48dd-9d60-ff5eb56e6763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.800986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489c728-42b5-48dd-9d60-ff5eb56e6763 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.815864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 305/611] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:19.823329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c3004-0cd3-4b6e-8322-097eb8d03d3f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.833369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c3004-0cd3-4b6e-8322-097eb8d03d3f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.838227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8ce66-b760-4ccb-b3fe-6c44293e51c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.839134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ce66-b760-4ccb-b3fe-6c44293e51c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.839455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ce66-b760-4ccb-b3fe-6c44293e51c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.839733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8ce66-b760-4ccb-b3fe-6c44293e51c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.848446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8ce66-b760-4ccb-b3fe-6c44293e51c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.875423 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8ce66-b760-4ccb-b3fe-6c44293e51c4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.889628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-dfe8ce66-b760-4ccb-b3fe-6c44293e51c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:19.890678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 307/612] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:19.896323 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489c728-42b5-48dd-9d60-ff5eb56e6763 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.905733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489c728-42b5-48dd-9d60-ff5eb56e6763 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.910092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de07261-13aa-47f3-8b20-6c58e8aa9b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.910669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de07261-13aa-47f3-8b20-6c58e8aa9b45 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.910956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de07261-13aa-47f3-8b20-6c58e8aa9b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.911236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de07261-13aa-47f3-8b20-6c58e8aa9b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.912002 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de07261-13aa-47f3-8b20-6c58e8aa9b45 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:19.912302 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de07261-13aa-47f3-8b20-6c58e8aa9b45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.938224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de07261-13aa-47f3-8b20-6c58e8aa9b45 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:19.951933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 306/613] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:19.957636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8ce66-b760-4ccb-b3fe-6c44293e51c4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:19.967187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8ce66-b760-4ccb-b3fe-6c44293e51c4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:19.971204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68902f7-9cb6-4c7c-867d-d72a914b1081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:19.971797 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68902f7-9cb6-4c7c-867d-d72a914b1081 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:19.972082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68902f7-9cb6-4c7c-867d-d72a914b1081 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:19.972362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68902f7-9cb6-4c7c-867d-d72a914b1081 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:19.973129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68902f7-9cb6-4c7c-867d-d72a914b1081 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=54e44c49e9ac4ea5bfed707bc26d6cca) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:19.973427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68902f7-9cb6-4c7c-867d-d72a914b1081 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:19.999359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68902f7-9cb6-4c7c-867d-d72a914b1081 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:20.005184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 308/614] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:40:19 2022] GET /identity/v3/role_assignments?user.id=54e44c49e9ac4ea5bfed707bc26d6cca&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:22.059233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11b0d1-f06b-4b4b-858c-5dedec0d8728 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.059788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11b0d1-f06b-4b4b-858c-5dedec0d8728 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.059927 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11b0d1-f06b-4b4b-858c-5dedec0d8728 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.061532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 307/615] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:22.066566 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52ecbe-687e-408d-9cb0-7666e3b97b15 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.066991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52ecbe-687e-408d-9cb0-7666e3b97b15 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.067136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52ecbe-687e-408d-9cb0-7666e3b97b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.090350 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-2d52ecbe-687e-408d-9cb0-7666e3b97b15 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:22.091216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2d52ecbe-687e-408d-9cb0-7666e3b97b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:22.098070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 309/616] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:22 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:40:22.121664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11b0d1-f06b-4b4b-858c-5dedec0d8728 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.133166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11b0d1-f06b-4b4b-858c-5dedec0d8728 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.137653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e2793-e8d8-4623-a59c-7b1888fe329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.138370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e2793-e8d8-4623-a59c-7b1888fe329f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.138659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e2793-e8d8-4623-a59c-7b1888fe329f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.138936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e2793-e8d8-4623-a59c-7b1888fe329f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.149736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e2793-e8d8-4623-a59c-7b1888fe329f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:22.156465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-458e2793-e8d8-4623-a59c-7b1888fe329f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 18 12:40:22.157773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 308/617] 10.222.0.87 () {56 vars in 1141 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:22.163535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52ecbe-687e-408d-9cb0-7666e3b97b15 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.172122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52ecbe-687e-408d-9cb0-7666e3b97b15 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.176400 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab78fe-63b3-42d1-8ac2-d0da6c76fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.176983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab78fe-63b3-42d1-8ac2-d0da6c76fa04 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.177269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab78fe-63b3-42d1-8ac2-d0da6c76fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.177549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab78fe-63b3-42d1-8ac2-d0da6c76fa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.178246 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab78fe-63b3-42d1-8ac2-d0da6c76fa04 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:22.178544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab78fe-63b3-42d1-8ac2-d0da6c76fa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.205534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab78fe-63b3-42d1-8ac2-d0da6c76fa04 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.214399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 310/618] 10.222.0.87 () {56 vars in 1136 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:22.219956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e2793-e8d8-4623-a59c-7b1888fe329f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.229784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e2793-e8d8-4623-a59c-7b1888fe329f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.233807 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c60d49-06b8-4fd3-bfd9-b9acc62e2879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.234505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c60d49-06b8-4fd3-bfd9-b9acc62e2879 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.234790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c60d49-06b8-4fd3-bfd9-b9acc62e2879 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.235064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c60d49-06b8-4fd3-bfd9-b9acc62e2879 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.246741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c60d49-06b8-4fd3-bfd9-b9acc62e2879 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.272939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c60d49-06b8-4fd3-bfd9-b9acc62e2879 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.291662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-19c60d49-06b8-4fd3-bfd9-b9acc62e2879 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:22.292721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 309/619] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:22.298219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab78fe-63b3-42d1-8ac2-d0da6c76fa04 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.308039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab78fe-63b3-42d1-8ac2-d0da6c76fa04 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.312441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3a330-c497-42ec-856b-1d9678d3d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.313076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3a330-c497-42ec-856b-1d9678d3d358 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.313366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3a330-c497-42ec-856b-1d9678d3d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.313647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3a330-c497-42ec-856b-1d9678d3d358 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.314327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3a330-c497-42ec-856b-1d9678d3d358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:22.314623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3a330-c497-42ec-856b-1d9678d3d358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.341051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3a330-c497-42ec-856b-1d9678d3d358 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.354134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 311/620] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:22.359577 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c60d49-06b8-4fd3-bfd9-b9acc62e2879 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.369298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c60d49-06b8-4fd3-bfd9-b9acc62e2879 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.373276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e6795-0490-4f9e-8442-61ffe754a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.373992 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e6795-0490-4f9e-8442-61ffe754a86f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.374272 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e6795-0490-4f9e-8442-61ffe754a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.374546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e6795-0490-4f9e-8442-61ffe754a86f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.387810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e6795-0490-4f9e-8442-61ffe754a86f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.413734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e6795-0490-4f9e-8442-61ffe754a86f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.432502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-ed1e6795-0490-4f9e-8442-61ffe754a86f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 18 12:40:22.433554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 310/621] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:22.439136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3a330-c497-42ec-856b-1d9678d3d358 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.449339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3a330-c497-42ec-856b-1d9678d3d358 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.453364 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3271ff5-3bd5-4777-80b5-0e7c36123354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.453953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271ff5-3bd5-4777-80b5-0e7c36123354 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.454242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271ff5-3bd5-4777-80b5-0e7c36123354 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.454525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3271ff5-3bd5-4777-80b5-0e7c36123354 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.455320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3271ff5-3bd5-4777-80b5-0e7c36123354 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:22.455633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3271ff5-3bd5-4777-80b5-0e7c36123354 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.481591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3271ff5-3bd5-4777-80b5-0e7c36123354 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.510927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 312/622] 10.222.0.87 () {56 vars in 1170 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:22.518240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e6795-0490-4f9e-8442-61ffe754a86f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.528092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e6795-0490-4f9e-8442-61ffe754a86f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.532427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1202577-30bb-4f3a-8d10-03fd9e5f1184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.532994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1202577-30bb-4f3a-8d10-03fd9e5f1184 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.533282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1202577-30bb-4f3a-8d10-03fd9e5f1184 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.533560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1202577-30bb-4f3a-8d10-03fd9e5f1184 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.542232 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1202577-30bb-4f3a-8d10-03fd9e5f1184 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.568523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1202577-30bb-4f3a-8d10-03fd9e5f1184 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.577418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 311/623] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 12:40:22.582935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3271ff5-3bd5-4777-80b5-0e7c36123354 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.592238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3271ff5-3bd5-4777-80b5-0e7c36123354 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.597249 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be5866-040e-49ba-ac9c-184dba9f242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.597970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be5866-040e-49ba-ac9c-184dba9f242d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.598258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be5866-040e-49ba-ac9c-184dba9f242d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.598541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be5866-040e-49ba-ac9c-184dba9f242d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.610806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be5866-040e-49ba-ac9c-184dba9f242d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.637269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be5866-040e-49ba-ac9c-184dba9f242d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.654260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-51be5866-040e-49ba-ac9c-184dba9f242d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:22.655359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 313/624] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:22.661140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1202577-30bb-4f3a-8d10-03fd9e5f1184 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.671293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1202577-30bb-4f3a-8d10-03fd9e5f1184 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.675291 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8476156-ce93-4bea-abea-ce1b8c525cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.675914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476156-ce93-4bea-abea-ce1b8c525cda admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.676240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476156-ce93-4bea-abea-ce1b8c525cda admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.676520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476156-ce93-4bea-abea-ce1b8c525cda admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.677191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8476156-ce93-4bea-abea-ce1b8c525cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:22.677484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8476156-ce93-4bea-abea-ce1b8c525cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.704120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8476156-ce93-4bea-abea-ce1b8c525cda admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.718202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 312/625] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:22.723854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be5866-040e-49ba-ac9c-184dba9f242d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.733234 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be5866-040e-49ba-ac9c-184dba9f242d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.737210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d742e7-1aac-4753-9da9-7ef3997562f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.737913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d742e7-1aac-4753-9da9-7ef3997562f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.738198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d742e7-1aac-4753-9da9-7ef3997562f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.738477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d742e7-1aac-4753-9da9-7ef3997562f5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.749072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d742e7-1aac-4753-9da9-7ef3997562f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.776035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d742e7-1aac-4753-9da9-7ef3997562f5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.789589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-71d742e7-1aac-4753-9da9-7ef3997562f5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:22.790742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 314/626] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:22.796587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8476156-ce93-4bea-abea-ce1b8c525cda admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.806351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8476156-ce93-4bea-abea-ce1b8c525cda admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.810350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d691496-4fc6-46f8-b14a-d30605866cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.810951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691496-4fc6-46f8-b14a-d30605866cfa admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.811235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691496-4fc6-46f8-b14a-d30605866cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.811545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d691496-4fc6-46f8-b14a-d30605866cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.812288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d691496-4fc6-46f8-b14a-d30605866cfa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:22.812588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d691496-4fc6-46f8-b14a-d30605866cfa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.840368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d691496-4fc6-46f8-b14a-d30605866cfa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.854448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 313/627] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:22.860493 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d742e7-1aac-4753-9da9-7ef3997562f5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:22.870304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d742e7-1aac-4753-9da9-7ef3997562f5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:22.874319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabdb81-8558-4355-ac77-1efbb8ee6f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:22.874891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabdb81-8558-4355-ac77-1efbb8ee6f04 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:22.875191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabdb81-8558-4355-ac77-1efbb8ee6f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:22.875511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabdb81-8558-4355-ac77-1efbb8ee6f04 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:22.876279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabdb81-8558-4355-ac77-1efbb8ee6f04 admin admin] RBAC: Adding query filter params (role.id=8f3f7f63a59d41099278b8a851d40286, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=54e44c49e9ac4ea5bfed707bc26d6cca) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:22.876584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabdb81-8558-4355-ac77-1efbb8ee6f04 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:22.902751 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabdb81-8558-4355-ac77-1efbb8ee6f04 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:22.908350 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 315/628] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:40:22 2022] GET /identity/v3/role_assignments?user.id=54e44c49e9ac4ea5bfed707bc26d6cca&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=8f3f7f63a59d41099278b8a851d40286 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:24.862482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fc8ad-21ea-457d-b4ce-0bbd506b9513 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:24.863004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fc8ad-21ea-457d-b4ce-0bbd506b9513 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:24.863088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fc8ad-21ea-457d-b4ce-0bbd506b9513 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:24.864739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 314/629] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:24.869926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fb5ca-39a4-4b48-a649-c94b4465587e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:24.870343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fb5ca-39a4-4b48-a649-c94b4465587e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:24.870486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471fb5ca-39a4-4b48-a649-c94b4465587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:24.893365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-471fb5ca-39a4-4b48-a649-c94b4465587e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:24.894467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-471fb5ca-39a4-4b48-a649-c94b4465587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:24.901736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 316/630] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:24 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:24.923870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fc8ad-21ea-457d-b4ce-0bbd506b9513 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:24.936147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fc8ad-21ea-457d-b4ce-0bbd506b9513 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:24.940143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20cb00-c988-4c6d-b472-7d046f55a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:24.940875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20cb00-c988-4c6d-b472-7d046f55a21f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:24.941161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20cb00-c988-4c6d-b472-7d046f55a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:24.941438 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20cb00-c988-4c6d-b472-7d046f55a21f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:24.954254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20cb00-c988-4c6d-b472-7d046f55a21f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:24.965895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-be20cb00-c988-4c6d-b472-7d046f55a21f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 18 12:40:24.967028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 315/631] 10.222.0.87 () {56 vars in 1141 bytes} [Tue Jan 18 12:40:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:24.973026 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fb5ca-39a4-4b48-a649-c94b4465587e None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:24.982212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471fb5ca-39a4-4b48-a649-c94b4465587e None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:24.987227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4a1dd-1596-477a-ac73-0b1e5def8f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:24.987838 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a1dd-1596-477a-ac73-0b1e5def8f3e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:24.988124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a1dd-1596-477a-ac73-0b1e5def8f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:24.988405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4a1dd-1596-477a-ac73-0b1e5def8f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:24.989462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4a1dd-1596-477a-ac73-0b1e5def8f3e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:24.990225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4a1dd-1596-477a-ac73-0b1e5def8f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.016970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4a1dd-1596-477a-ac73-0b1e5def8f3e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.026466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 317/632] 10.222.0.87 () {56 vars in 1136 bytes} [Tue Jan 18 12:40:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:25.032334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20cb00-c988-4c6d-b472-7d046f55a21f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:25.042254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20cb00-c988-4c6d-b472-7d046f55a21f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:25.046340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2338e-0a61-401e-b176-2e928ba746f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:25.047048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2338e-0a61-401e-b176-2e928ba746f9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:25.047365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2338e-0a61-401e-b176-2e928ba746f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:25.047653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2338e-0a61-401e-b176-2e928ba746f9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:25.060006 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2338e-0a61-401e-b176-2e928ba746f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.086067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2338e-0a61-401e-b176-2e928ba746f9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.104289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-1de2338e-0a61-401e-b176-2e928ba746f9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:25.105428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 316/633] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:25.111293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4a1dd-1596-477a-ac73-0b1e5def8f3e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:25.121583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4a1dd-1596-477a-ac73-0b1e5def8f3e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:25.125561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f28b1-cc3a-4498-a2b5-7e356ff2dbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:25.126141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f28b1-cc3a-4498-a2b5-7e356ff2dbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:25.126433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f28b1-cc3a-4498-a2b5-7e356ff2dbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:25.126719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f28b1-cc3a-4498-a2b5-7e356ff2dbb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:25.127435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f28b1-cc3a-4498-a2b5-7e356ff2dbb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:25.127746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f28b1-cc3a-4498-a2b5-7e356ff2dbb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.155619 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f28b1-cc3a-4498-a2b5-7e356ff2dbb5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.169691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 318/634] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:25.175284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2338e-0a61-401e-b176-2e928ba746f9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:25.185409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2338e-0a61-401e-b176-2e928ba746f9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:25.189343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235261a-46a3-4f46-837b-95941978dd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:25.190061 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235261a-46a3-4f46-837b-95941978dd5c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:25.190344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235261a-46a3-4f46-837b-95941978dd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:25.190621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235261a-46a3-4f46-837b-95941978dd5c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:25.203941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235261a-46a3-4f46-837b-95941978dd5c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.246734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235261a-46a3-4f46-837b-95941978dd5c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.266580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-a235261a-46a3-4f46-837b-95941978dd5c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 18 12:40:25.267725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 317/635] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:40:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:25.273521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f28b1-cc3a-4498-a2b5-7e356ff2dbb5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:25.283768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f28b1-cc3a-4498-a2b5-7e356ff2dbb5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:25.287839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e934d42-56ad-4d79-9760-ffa038e41123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:25.288433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934d42-56ad-4d79-9760-ffa038e41123 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:25.288715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934d42-56ad-4d79-9760-ffa038e41123 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:25.288988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934d42-56ad-4d79-9760-ffa038e41123 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:25.289764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934d42-56ad-4d79-9760-ffa038e41123 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:25.290144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934d42-56ad-4d79-9760-ffa038e41123 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.316444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934d42-56ad-4d79-9760-ffa038e41123 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.347467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 319/636] 10.222.0.87 () {56 vars in 1170 bytes} [Tue Jan 18 12:40:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:25.353744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235261a-46a3-4f46-837b-95941978dd5c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:25.363148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235261a-46a3-4f46-837b-95941978dd5c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:25.367211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f12a7a-20a1-4237-b586-786250012a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:25.368505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f12a7a-20a1-4237-b586-786250012a64 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:25.369088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f12a7a-20a1-4237-b586-786250012a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:25.369204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f12a7a-20a1-4237-b586-786250012a64 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:25.381378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f12a7a-20a1-4237-b586-786250012a64 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.407737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f12a7a-20a1-4237-b586-786250012a64 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.425479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-65f12a7a-20a1-4237-b586-786250012a64 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:25.426557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 318/637] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:25.432830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e934d42-56ad-4d79-9760-ffa038e41123 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:25.442198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e934d42-56ad-4d79-9760-ffa038e41123 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:25.446195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541ab5e-731b-4cdf-bf5f-c591d47006e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:25.446948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541ab5e-731b-4cdf-bf5f-c591d47006e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:25.447281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541ab5e-731b-4cdf-bf5f-c591d47006e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:25.447598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541ab5e-731b-4cdf-bf5f-c591d47006e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:25.448284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541ab5e-731b-4cdf-bf5f-c591d47006e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:25.448586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541ab5e-731b-4cdf-bf5f-c591d47006e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.474270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541ab5e-731b-4cdf-bf5f-c591d47006e8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.487095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 320/638] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:25.493646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f12a7a-20a1-4237-b586-786250012a64 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:25.503642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f12a7a-20a1-4237-b586-786250012a64 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:25.507585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3bc08-4b08-40f9-a669-e10e7bee5dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:25.508290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3bc08-4b08-40f9-a669-e10e7bee5dac admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:25.509175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3bc08-4b08-40f9-a669-e10e7bee5dac admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:25.509630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3bc08-4b08-40f9-a669-e10e7bee5dac admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:25.518671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3bc08-4b08-40f9-a669-e10e7bee5dac admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.545108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3bc08-4b08-40f9-a669-e10e7bee5dac admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.559061 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-f7c3bc08-4b08-40f9-a669-e10e7bee5dac admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:25.560186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 319/639] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:25.565780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541ab5e-731b-4cdf-bf5f-c591d47006e8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:25.575724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541ab5e-731b-4cdf-bf5f-c591d47006e8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:25.579696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e1edf-ef48-49d2-a743-1ba2ff764db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:25.580267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e1edf-ef48-49d2-a743-1ba2ff764db1 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:25.580553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e1edf-ef48-49d2-a743-1ba2ff764db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:25.580833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e1edf-ef48-49d2-a743-1ba2ff764db1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:25.581559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e1edf-ef48-49d2-a743-1ba2ff764db1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:25.581855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e1edf-ef48-49d2-a743-1ba2ff764db1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.607928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e1edf-ef48-49d2-a743-1ba2ff764db1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.620686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 321/640] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:25.626540 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3bc08-4b08-40f9-a669-e10e7bee5dac admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:25.636694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3bc08-4b08-40f9-a669-e10e7bee5dac admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:25.640557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8c40b-addc-475d-aae2-1d2f577de844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:25.641380 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8c40b-addc-475d-aae2-1d2f577de844 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:25.641662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8c40b-addc-475d-aae2-1d2f577de844 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:25.641946 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8c40b-addc-475d-aae2-1d2f577de844 admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/54e44c49e9ac4ea5bfed707bc26d6cca/roles/8f3f7f63a59d41099278b8a851d40286` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:25.643926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8c40b-addc-475d-aae2-1d2f577de844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=54e44c49e9ac4ea5bfed707bc26d6cca, role_id=8f3f7f63a59d41099278b8a851d40286)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:25.671281 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8c40b-addc-475d-aae2-1d2f577de844 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:25.771989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 320/641] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:40:25 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/54e44c49e9ac4ea5bfed707bc26d6cca/roles/8f3f7f63a59d41099278b8a851d40286 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:40:27.748104 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6d81-1409-4fe4-b769-c041d8ec8f75 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:27.748702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6d81-1409-4fe4-b769-c041d8ec8f75 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:27.748702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde6d81-1409-4fe4-b769-c041d8ec8f75 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:27.750356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 322/642] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:27.755561 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7e26-c7d3-450d-90f7-8dd815908178 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:27.755970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7e26-c7d3-450d-90f7-8dd815908178 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:27.756136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c7e26-c7d3-450d-90f7-8dd815908178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:27.779543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-980c7e26-c7d3-450d-90f7-8dd815908178 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:27.780681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-980c7e26-c7d3-450d-90f7-8dd815908178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:27.851220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 321/643] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:27 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:27.875300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde6d81-1409-4fe4-b769-c041d8ec8f75 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:27.887446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde6d81-1409-4fe4-b769-c041d8ec8f75 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:27.891336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040fbb9-efba-4796-a923-fcec182dfa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:27.892074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040fbb9-efba-4796-a923-fcec182dfa95 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:27.892362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040fbb9-efba-4796-a923-fcec182dfa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:27.892641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040fbb9-efba-4796-a923-fcec182dfa95 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:27.904216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040fbb9-efba-4796-a923-fcec182dfa95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:27.911293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-a040fbb9-efba-4796-a923-fcec182dfa95 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 18 12:40:27.912437 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 323/644] 10.222.0.87 () {56 vars in 1141 bytes} [Tue Jan 18 12:40:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:27.918841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7e26-c7d3-450d-90f7-8dd815908178 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:27.927633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c7e26-c7d3-450d-90f7-8dd815908178 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:27.932452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c257e-25dc-41b8-beaa-2e67233c7406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:27.933080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c257e-25dc-41b8-beaa-2e67233c7406 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:27.933366 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c257e-25dc-41b8-beaa-2e67233c7406 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:27.933647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c257e-25dc-41b8-beaa-2e67233c7406 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:27.934358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c257e-25dc-41b8-beaa-2e67233c7406 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:27.934655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c257e-25dc-41b8-beaa-2e67233c7406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:27.960228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c257e-25dc-41b8-beaa-2e67233c7406 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:27.970710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 322/645] 10.222.0.87 () {56 vars in 1136 bytes} [Tue Jan 18 12:40:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:27.976312 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040fbb9-efba-4796-a923-fcec182dfa95 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:27.986672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040fbb9-efba-4796-a923-fcec182dfa95 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:27.990651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80712-d580-4823-a0b7-f5641758cd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:27.991384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80712-d580-4823-a0b7-f5641758cd88 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:27.991680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80712-d580-4823-a0b7-f5641758cd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:27.991959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f80712-d580-4823-a0b7-f5641758cd88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.003934 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80712-d580-4823-a0b7-f5641758cd88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.029605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f80712-d580-4823-a0b7-f5641758cd88 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.047333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-a8f80712-d580-4823-a0b7-f5641758cd88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:28.048416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 324/646] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:28.053852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c257e-25dc-41b8-beaa-2e67233c7406 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:28.064140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c257e-25dc-41b8-beaa-2e67233c7406 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:28.068169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161069e-64e4-4e31-b180-76cf0ceaae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:28.068750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161069e-64e4-4e31-b180-76cf0ceaae46 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:28.069028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161069e-64e4-4e31-b180-76cf0ceaae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:28.069304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2161069e-64e4-4e31-b180-76cf0ceaae46 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.069980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161069e-64e4-4e31-b180-76cf0ceaae46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:28.070273 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161069e-64e4-4e31-b180-76cf0ceaae46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.096082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2161069e-64e4-4e31-b180-76cf0ceaae46 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.110777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 323/647] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:28.116214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80712-d580-4823-a0b7-f5641758cd88 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:28.125510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f80712-d580-4823-a0b7-f5641758cd88 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:28.129549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f334f59-ccc8-4419-8652-5e91623625f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:28.130277 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f334f59-ccc8-4419-8652-5e91623625f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:28.130570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f334f59-ccc8-4419-8652-5e91623625f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:28.130856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f334f59-ccc8-4419-8652-5e91623625f7 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.143442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f334f59-ccc8-4419-8652-5e91623625f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.170846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f334f59-ccc8-4419-8652-5e91623625f7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.188833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-7f334f59-ccc8-4419-8652-5e91623625f7 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 18 12:40:28.189903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 325/648] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:40:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:40:28.195576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161069e-64e4-4e31-b180-76cf0ceaae46 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:28.205029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2161069e-64e4-4e31-b180-76cf0ceaae46 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:28.209211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836df04d-329b-4f9a-b7b7-3b406443473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:28.209800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836df04d-329b-4f9a-b7b7-3b406443473d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:28.210083 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836df04d-329b-4f9a-b7b7-3b406443473d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:28.210359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836df04d-329b-4f9a-b7b7-3b406443473d admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.211140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836df04d-329b-4f9a-b7b7-3b406443473d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:28.212028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836df04d-329b-4f9a-b7b7-3b406443473d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.238462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836df04d-329b-4f9a-b7b7-3b406443473d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.268248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 324/649] 10.222.0.87 () {56 vars in 1170 bytes} [Tue Jan 18 12:40:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:28.273911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f334f59-ccc8-4419-8652-5e91623625f7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:28.284173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f334f59-ccc8-4419-8652-5e91623625f7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:28.288220 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e716907-c8f8-49d7-99a4-d6cc2244b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:28.288784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e716907-c8f8-49d7-99a4-d6cc2244b081 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:28.289073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e716907-c8f8-49d7-99a4-d6cc2244b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:28.289356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e716907-c8f8-49d7-99a4-d6cc2244b081 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.297705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e716907-c8f8-49d7-99a4-d6cc2244b081 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.323516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e716907-c8f8-49d7-99a4-d6cc2244b081 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.332134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 326/650] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:40:28 2022] GET /identity/v3/auth/tokens => generated 1616 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:40:28.338189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836df04d-329b-4f9a-b7b7-3b406443473d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:28.347648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836df04d-329b-4f9a-b7b7-3b406443473d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:28.351885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3659c-a1fd-4a11-a1bd-f0937e8858d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:28.353176 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3659c-a1fd-4a11-a1bd-f0937e8858d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:28.353461 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3659c-a1fd-4a11-a1bd-f0937e8858d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:28.353738 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3659c-a1fd-4a11-a1bd-f0937e8858d9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.365503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3659c-a1fd-4a11-a1bd-f0937e8858d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.391513 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3659c-a1fd-4a11-a1bd-f0937e8858d9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.409419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-7be3659c-a1fd-4a11-a1bd-f0937e8858d9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:28.410500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 325/651] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:40:28.417188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e716907-c8f8-49d7-99a4-d6cc2244b081 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:28.425771 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e716907-c8f8-49d7-99a4-d6cc2244b081 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:28.429865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db496-c775-4f16-92ac-9522635d6351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:28.430873 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db496-c775-4f16-92ac-9522635d6351 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:28.431170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db496-c775-4f16-92ac-9522635d6351 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:28.431497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db496-c775-4f16-92ac-9522635d6351 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.432176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4db496-c775-4f16-92ac-9522635d6351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:28.432481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4db496-c775-4f16-92ac-9522635d6351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.458757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4db496-c775-4f16-92ac-9522635d6351 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.473128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 327/652] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:28.479144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3659c-a1fd-4a11-a1bd-f0937e8858d9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:28.488690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3659c-a1fd-4a11-a1bd-f0937e8858d9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:28.492665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e676c-dd6f-4ddc-b538-d6da9eca1844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:28.493621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e676c-dd6f-4ddc-b538-d6da9eca1844 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:28.493940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e676c-dd6f-4ddc-b538-d6da9eca1844 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:28.494255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e676c-dd6f-4ddc-b538-d6da9eca1844 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.503297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e676c-dd6f-4ddc-b538-d6da9eca1844 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.530353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e676c-dd6f-4ddc-b538-d6da9eca1844 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.544530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b75e676c-dd6f-4ddc-b538-d6da9eca1844 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:28.545615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 326/653] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:28.551391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db496-c775-4f16-92ac-9522635d6351 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:28.561236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db496-c775-4f16-92ac-9522635d6351 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:28.565295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83376b1c-3863-438e-9f46-c40a51e22f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:28.565874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376b1c-3863-438e-9f46-c40a51e22f4d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:28.566168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376b1c-3863-438e-9f46-c40a51e22f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:28.566455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83376b1c-3863-438e-9f46-c40a51e22f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.567189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376b1c-3863-438e-9f46-c40a51e22f4d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:28.567530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376b1c-3863-438e-9f46-c40a51e22f4d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.594712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83376b1c-3863-438e-9f46-c40a51e22f4d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.607811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 328/654] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:28.613830 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e676c-dd6f-4ddc-b538-d6da9eca1844 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:28.623256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e676c-dd6f-4ddc-b538-d6da9eca1844 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:28.627153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec4716-2a7c-4d14-b963-8706c3dced7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:28.627757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4716-2a7c-4d14-b963-8706c3dced7a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:28.628042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4716-2a7c-4d14-b963-8706c3dced7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:28.628321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec4716-2a7c-4d14-b963-8706c3dced7a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:28.629098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec4716-2a7c-4d14-b963-8706c3dced7a admin admin] RBAC: Adding query filter params (role.id=8f3f7f63a59d41099278b8a851d40286, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=54e44c49e9ac4ea5bfed707bc26d6cca) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:28.629400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec4716-2a7c-4d14-b963-8706c3dced7a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:28.656554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec4716-2a7c-4d14-b963-8706c3dced7a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:28.662740 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 327/655] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:40:28 2022] GET /identity/v3/role_assignments?user.id=54e44c49e9ac4ea5bfed707bc26d6cca&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=8f3f7f63a59d41099278b8a851d40286 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:30.728817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007d7d0-7593-443b-a156-4b39e4dd5ea1 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:30.729340 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007d7d0-7593-443b-a156-4b39e4dd5ea1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:30.729450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007d7d0-7593-443b-a156-4b39e4dd5ea1 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:30.731088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 329/656] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:30.736157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187da39-9e78-4453-a1bd-69f4657ecd4e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:30.736531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187da39-9e78-4453-a1bd-69f4657ecd4e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:30.736735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187da39-9e78-4453-a1bd-69f4657ecd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:30.760480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-2187da39-9e78-4453-a1bd-69f4657ecd4e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:30.761631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-2187da39-9e78-4453-a1bd-69f4657ecd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:30.768404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 328/657] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:30 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:30.791010 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007d7d0-7593-443b-a156-4b39e4dd5ea1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:30.802410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4007d7d0-7593-443b-a156-4b39e4dd5ea1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:30.806378 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820e852-1c40-44e0-90fd-ca170b3d63ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:30.807190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820e852-1c40-44e0-90fd-ca170b3d63ac admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:30.807510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820e852-1c40-44e0-90fd-ca170b3d63ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:30.807788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820e852-1c40-44e0-90fd-ca170b3d63ac admin admin] PATH_INFO: `/v3/services/image` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:30.808396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820e852-1c40-44e0-90fd-ca170b3d63ac admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:30.834490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820e852-1c40-44e0-90fd-ca170b3d63ac admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:30.846854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-f820e852-1c40-44e0-90fd-ca170b3d63ac admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 18 12:40:30.848109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 330/658] 10.222.0.87 () {56 vars in 1126 bytes} [Tue Jan 18 12:40:30 2022] GET /identity/v3/services/image => generated 86 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:40:30.854215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187da39-9e78-4453-a1bd-69f4657ecd4e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:30.862805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187da39-9e78-4453-a1bd-69f4657ecd4e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:30.866862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb760506-c5da-4074-a961-89317b9c408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:30.867486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760506-c5da-4074-a961-89317b9c408d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:30.867984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760506-c5da-4074-a961-89317b9c408d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:30.868434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb760506-c5da-4074-a961-89317b9c408d admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:30.869114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb760506-c5da-4074-a961-89317b9c408d admin admin] RBAC: Adding query filter params (name=image) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:30.869418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb760506-c5da-4074-a961-89317b9c408d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:30.895437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb760506-c5da-4074-a961-89317b9c408d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:30.900739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 329/659] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:30.906242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820e852-1c40-44e0-90fd-ca170b3d63ac admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:30.915952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820e852-1c40-44e0-90fd-ca170b3d63ac admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:30.919987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18075672-bcb1-4f06-945c-d046a665e6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:30.920564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18075672-bcb1-4f06-945c-d046a665e6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:30.920857 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18075672-bcb1-4f06-945c-d046a665e6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:30.921135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18075672-bcb1-4f06-945c-d046a665e6a8 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:30.921791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18075672-bcb1-4f06-945c-d046a665e6a8 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:30.922088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18075672-bcb1-4f06-945c-d046a665e6a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:30.947979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18075672-bcb1-4f06-945c-d046a665e6a8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:30.952849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 331/660] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:30 2022] GET /identity/v3/services?type=image => generated 122 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:32.930179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51bdfc-9006-4c1a-842e-754e1c754ef9 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:32.930706 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51bdfc-9006-4c1a-842e-754e1c754ef9 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:32.930829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51bdfc-9006-4c1a-842e-754e1c754ef9 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:32.932534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 330/661] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:32.937529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc87c-fea5-497a-88b5-a8fb227abba2 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:32.937927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc87c-fea5-497a-88b5-a8fb227abba2 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:32.938108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc87c-fea5-497a-88b5-a8fb227abba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:32.961015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-745bc87c-fea5-497a-88b5-a8fb227abba2 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:32.963184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-745bc87c-fea5-497a-88b5-a8fb227abba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:32.974150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 332/662] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:32 2022] POST /identity/v3/auth/tokens => generated 1616 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:32.997206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51bdfc-9006-4c1a-842e-754e1c754ef9 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:33.009588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51bdfc-9006-4c1a-842e-754e1c754ef9 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:33.013554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c40e5-3885-4155-8b98-82d2c0b9aae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:33.014128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c40e5-3885-4155-8b98-82d2c0b9aae6 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:33.014409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c40e5-3885-4155-8b98-82d2c0b9aae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:33.014684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c40e5-3885-4155-8b98-82d2c0b9aae6 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:33.015403 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c40e5-3885-4155-8b98-82d2c0b9aae6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:33.041672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c40e5-3885-4155-8b98-82d2c0b9aae6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:33.150372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 331/663] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:40:32 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:40:35.169720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a300d-35e6-4d50-bd01-ba3f295c1edd None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:35.170231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a300d-35e6-4d50-bd01-ba3f295c1edd None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:35.170318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a300d-35e6-4d50-bd01-ba3f295c1edd None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:35.171999 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 333/664] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:35.177395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda639-a3e3-43d8-873d-6acbbc2e23ed None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:35.177847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda639-a3e3-43d8-873d-6acbbc2e23ed None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:35.177938 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeda639-a3e3-43d8-873d-6acbbc2e23ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:35.200586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ffeda639-a3e3-43d8-873d-6acbbc2e23ed None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:35.201695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ffeda639-a3e3-43d8-873d-6acbbc2e23ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:35.219379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 332/665] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:35 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:35.241434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a300d-35e6-4d50-bd01-ba3f295c1edd None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:35.253177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a300d-35e6-4d50-bd01-ba3f295c1edd None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:35.257065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f574f-942e-40d9-983f-1ca5464c06ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:35.257767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f574f-942e-40d9-983f-1ca5464c06ed admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:35.258606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f574f-942e-40d9-983f-1ca5464c06ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:35.259396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f574f-942e-40d9-983f-1ca5464c06ed admin admin] PATH_INFO: `/v3/services/image` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:35.260112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f574f-942e-40d9-983f-1ca5464c06ed admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:35.287282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f574f-942e-40d9-983f-1ca5464c06ed admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:35.300241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-e27f574f-942e-40d9-983f-1ca5464c06ed admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 18 12:40:35.301440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 334/666] 10.222.0.87 () {56 vars in 1126 bytes} [Tue Jan 18 12:40:35 2022] GET /identity/v3/services/image => generated 86 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:35.308665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda639-a3e3-43d8-873d-6acbbc2e23ed None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:35.317303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeda639-a3e3-43d8-873d-6acbbc2e23ed None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:35.322381 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fed52-cede-426a-a39b-6f3a58c382e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:35.322966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fed52-cede-426a-a39b-6f3a58c382e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:35.323249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fed52-cede-426a-a39b-6f3a58c382e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:35.323557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fed52-cede-426a-a39b-6f3a58c382e9 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:35.324233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fed52-cede-426a-a39b-6f3a58c382e9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:35.324526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fed52-cede-426a-a39b-6f3a58c382e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:35.350059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fed52-cede-426a-a39b-6f3a58c382e9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:35.360265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 333/667] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:35.365982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f574f-942e-40d9-983f-1ca5464c06ed admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:35.376803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f574f-942e-40d9-983f-1ca5464c06ed admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:35.380932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb699-4a96-4f39-9f20-70dd075018e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:35.381516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb699-4a96-4f39-9f20-70dd075018e4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:35.381804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb699-4a96-4f39-9f20-70dd075018e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:35.382086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb699-4a96-4f39-9f20-70dd075018e4 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:35.382748 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eb699-4a96-4f39-9f20-70dd075018e4 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:35.383057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eb699-4a96-4f39-9f20-70dd075018e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:35.408751 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967eb699-4a96-4f39-9f20-70dd075018e4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:35.413611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 335/668] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:35.419992 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fed52-cede-426a-a39b-6f3a58c382e9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:35.429550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fed52-cede-426a-a39b-6f3a58c382e9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:35.434457 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b524e7-36ce-40cf-9362-b54ae51bf5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:35.435035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b524e7-36ce-40cf-9362-b54ae51bf5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:35.435351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b524e7-36ce-40cf-9362-b54ae51bf5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:35.435638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b524e7-36ce-40cf-9362-b54ae51bf5c7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:35.436382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b524e7-36ce-40cf-9362-b54ae51bf5c7 admin admin] RBAC: Adding query filter params (interface=public, service_id=251c82f53b7b442e885bd7a1de1c10a1, region_id=RegionOne) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:35.436687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b524e7-36ce-40cf-9362-b54ae51bf5c7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:35.462186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b524e7-36ce-40cf-9362-b54ae51bf5c7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:35.467703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 334/669] 10.222.0.87 () {56 vars in 1272 bytes} [Tue Jan 18 12:40:35 2022] GET /identity/v3/endpoints?service_id=251c82f53b7b442e885bd7a1de1c10a1&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:35.473348 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb699-4a96-4f39-9f20-70dd075018e4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:35.483331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb699-4a96-4f39-9f20-70dd075018e4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:35.487393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa5c8df-0a28-4f96-b615-c7b402f16ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:35.487998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c8df-0a28-4f96-b615-c7b402f16ede admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:35.488288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c8df-0a28-4f96-b615-c7b402f16ede admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:35.488602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa5c8df-0a28-4f96-b615-c7b402f16ede admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:35.489245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5c8df-0a28-4f96-b615-c7b402f16ede admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:35.518865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa5c8df-0a28-4f96-b615-c7b402f16ede admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:35.525113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 336/670] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:40:35 2022] GET /identity/v3/services => generated 1022 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 12:40:37.524724 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27d1f7-1988-4acf-a922-7309a0fde45b None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:37.525245 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27d1f7-1988-4acf-a922-7309a0fde45b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:37.525422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27d1f7-1988-4acf-a922-7309a0fde45b None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:37.527723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 335/671] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 12:40:37.533129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165add0-590b-4ed3-9703-24100f9e4571 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:37.533538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165add0-590b-4ed3-9703-24100f9e4571 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:37.533680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165add0-590b-4ed3-9703-24100f9e4571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:37.558271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7165add0-590b-4ed3-9703-24100f9e4571 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:37.559408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7165add0-590b-4ed3-9703-24100f9e4571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:37.565985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 337/672] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:37 2022] POST /identity/v3/auth/tokens => generated 1712 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:37.587937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27d1f7-1988-4acf-a922-7309a0fde45b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:37.599624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27d1f7-1988-4acf-a922-7309a0fde45b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:37.604601 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd2661-f392-47f8-8d41-cf5dfcef7aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:37.605312 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd2661-f392-47f8-8d41-cf5dfcef7aeb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:37.605598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd2661-f392-47f8-8d41-cf5dfcef7aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:37.605877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd2661-f392-47f8-8d41-cf5dfcef7aeb admin admin] PATH_INFO: `/v3/services/image` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:37.606498 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd2661-f392-47f8-8d41-cf5dfcef7aeb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:37.632796 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd2661-f392-47f8-8d41-cf5dfcef7aeb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:37.643249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-15dd2661-f392-47f8-8d41-cf5dfcef7aeb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 18 12:40:37.644358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 336/673] 10.222.0.87 () {56 vars in 1126 bytes} [Tue Jan 18 12:40:37 2022] GET /identity/v3/services/image => generated 86 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:37.650271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165add0-590b-4ed3-9703-24100f9e4571 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:37.659144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165add0-590b-4ed3-9703-24100f9e4571 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:37.663276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43079ec4-40c7-4f00-bc70-f40a1da44be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:37.663892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43079ec4-40c7-4f00-bc70-f40a1da44be2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:37.664182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43079ec4-40c7-4f00-bc70-f40a1da44be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:37.664466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43079ec4-40c7-4f00-bc70-f40a1da44be2 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:37.665641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43079ec4-40c7-4f00-bc70-f40a1da44be2 admin admin] RBAC: Adding query filter params (name=image) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:37.665937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43079ec4-40c7-4f00-bc70-f40a1da44be2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:37.692048 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43079ec4-40c7-4f00-bc70-f40a1da44be2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:37.696664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 338/674] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:37.702438 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd2661-f392-47f8-8d41-cf5dfcef7aeb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:37.711702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd2661-f392-47f8-8d41-cf5dfcef7aeb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:37.715694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750e1a1-4c24-4bd8-9708-2c0352bce759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:37.716274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e1a1-4c24-4bd8-9708-2c0352bce759 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:37.716560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e1a1-4c24-4bd8-9708-2c0352bce759 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:37.716840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e1a1-4c24-4bd8-9708-2c0352bce759 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:37.717507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e1a1-4c24-4bd8-9708-2c0352bce759 admin admin] RBAC: Adding query filter params (type=image) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:37.717804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e1a1-4c24-4bd8-9708-2c0352bce759 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:37.744234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750e1a1-4c24-4bd8-9708-2c0352bce759 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:37.749354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 337/675] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:37.754862 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43079ec4-40c7-4f00-bc70-f40a1da44be2 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:37.764425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43079ec4-40c7-4f00-bc70-f40a1da44be2 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:37.768493 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d7174-8a47-4e58-8d26-a40afb5ada2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:37.769075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7174-8a47-4e58-8d26-a40afb5ada2d admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:37.769368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7174-8a47-4e58-8d26-a40afb5ada2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:37.769648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d7174-8a47-4e58-8d26-a40afb5ada2d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:37.770333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d7174-8a47-4e58-8d26-a40afb5ada2d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:37.796485 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d7174-8a47-4e58-8d26-a40afb5ada2d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:37.866326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 339/676] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:40:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:40:39.859530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674dab3-a016-4d0d-b94d-bb4b5b725b5d None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:39.860088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674dab3-a016-4d0d-b94d-bb4b5b725b5d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:39.860088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674dab3-a016-4d0d-b94d-bb4b5b725b5d None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:39.861773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 338/677] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 12:40:39.867120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062c74-4204-4933-85df-300def220c22 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:39.867583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062c74-4204-4933-85df-300def220c22 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:39.867715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062c74-4204-4933-85df-300def220c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:39.890438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f2062c74-4204-4933-85df-300def220c22 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:39.891601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f2062c74-4204-4933-85df-300def220c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:39.908851 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 340/678] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:39 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:39.931824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674dab3-a016-4d0d-b94d-bb4b5b725b5d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:39.943363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674dab3-a016-4d0d-b94d-bb4b5b725b5d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:39.948270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd348e0-7570-4b2e-bfc5-50fc99f47d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:39.948838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd348e0-7570-4b2e-bfc5-50fc99f47d63 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:39.949130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd348e0-7570-4b2e-bfc5-50fc99f47d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:39.949414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd348e0-7570-4b2e-bfc5-50fc99f47d63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:39.956877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd348e0-7570-4b2e-bfc5-50fc99f47d63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:39.983821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd348e0-7570-4b2e-bfc5-50fc99f47d63 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:39.993699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 339/679] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:40:39 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:40:39.999481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062c74-4204-4933-85df-300def220c22 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:40.007960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062c74-4204-4933-85df-300def220c22 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:40.012535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e710bc56-347e-440c-b085-50116f8a855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:40.013244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710bc56-347e-440c-b085-50116f8a855a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:40.013531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710bc56-347e-440c-b085-50116f8a855a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:40.013810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710bc56-347e-440c-b085-50116f8a855a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:40.014896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710bc56-347e-440c-b085-50116f8a855a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:40.040949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e710bc56-347e-440c-b085-50116f8a855a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:40.042387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 341/680] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:42.135887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5b59-dd24-467f-9127-a02c95e31684 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:42.136469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5b59-dd24-467f-9127-a02c95e31684 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:42.138852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b5b59-dd24-467f-9127-a02c95e31684 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:42.140570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 340/681] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:42.149287 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ee2d3-7093-4025-8e23-1d47d52d1049 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:42.150182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ee2d3-7093-4025-8e23-1d47d52d1049 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:42.150481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ee2d3-7093-4025-8e23-1d47d52d1049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:42.173912 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5a4ee2d3-7093-4025-8e23-1d47d52d1049 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:42.175042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5a4ee2d3-7093-4025-8e23-1d47d52d1049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:42.182791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 342/682] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:42 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:42.206834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b5b59-dd24-467f-9127-a02c95e31684 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:42.218576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b5b59-dd24-467f-9127-a02c95e31684 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:42.222442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a30abb-4ad4-4853-b7e9-cbb1eb58d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:42.223149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a30abb-4ad4-4853-b7e9-cbb1eb58d4fe admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:42.223471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a30abb-4ad4-4853-b7e9-cbb1eb58d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:42.223754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a30abb-4ad4-4853-b7e9-cbb1eb58d4fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:42.235854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a30abb-4ad4-4853-b7e9-cbb1eb58d4fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:42.261975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a30abb-4ad4-4853-b7e9-cbb1eb58d4fe admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:42.279411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-f9a30abb-4ad4-4853-b7e9-cbb1eb58d4fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:42.280605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 341/683] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:40:42.286996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ee2d3-7093-4025-8e23-1d47d52d1049 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:42.296147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ee2d3-7093-4025-8e23-1d47d52d1049 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:42.300135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fbd21-b14f-4026-aa16-2edeb48619e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:42.300727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fbd21-b14f-4026-aa16-2edeb48619e1 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:42.301014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fbd21-b14f-4026-aa16-2edeb48619e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:42.301297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fbd21-b14f-4026-aa16-2edeb48619e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:42.301973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fbd21-b14f-4026-aa16-2edeb48619e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:42.302273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fbd21-b14f-4026-aa16-2edeb48619e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:42.328674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fbd21-b14f-4026-aa16-2edeb48619e1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:42.342081 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 343/684] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:42.347514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a30abb-4ad4-4853-b7e9-cbb1eb58d4fe admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:42.357537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a30abb-4ad4-4853-b7e9-cbb1eb58d4fe admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:42.361681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb26dd-979f-46f1-9156-f8df93ae0a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:42.362271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb26dd-979f-46f1-9156-f8df93ae0a80 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:42.362550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb26dd-979f-46f1-9156-f8df93ae0a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:42.362825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb26dd-979f-46f1-9156-f8df93ae0a80 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:42.363512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb26dd-979f-46f1-9156-f8df93ae0a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:42.391362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb26dd-979f-46f1-9156-f8df93ae0a80 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:42.486716 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 342/685] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:40:42 2022] POST /identity/v3/users => generated 248 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:40:44.497616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b6247-8ff0-4315-8a86-eaeb21f311a1 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:44.498121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b6247-8ff0-4315-8a86-eaeb21f311a1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:44.498221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b6247-8ff0-4315-8a86-eaeb21f311a1 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:44.499902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 344/686] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:44.505414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88458c-f3d0-4e5a-9bc8-f638c853d829 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:44.505877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88458c-f3d0-4e5a-9bc8-f638c853d829 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:44.505986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88458c-f3d0-4e5a-9bc8-f638c853d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:44.527690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-3c88458c-f3d0-4e5a-9bc8-f638c853d829 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:44.528870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-3c88458c-f3d0-4e5a-9bc8-f638c853d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:44.535934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 343/687] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:44 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:40:44.560192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b6247-8ff0-4315-8a86-eaeb21f311a1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:44.572210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b6247-8ff0-4315-8a86-eaeb21f311a1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:44.576233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bba89-54ee-473b-bac8-5fc0325c6462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:44.576917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bba89-54ee-473b-bac8-5fc0325c6462 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:44.577210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bba89-54ee-473b-bac8-5fc0325c6462 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:44.577497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bba89-54ee-473b-bac8-5fc0325c6462 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:44.589124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bba89-54ee-473b-bac8-5fc0325c6462 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:44.595426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-110bba89-54ee-473b-bac8-5fc0325c6462 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:40:44.596520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 345/688] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:40:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:44.602589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88458c-f3d0-4e5a-9bc8-f638c853d829 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:44.612030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88458c-f3d0-4e5a-9bc8-f638c853d829 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:44.616066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8eb57-84e7-4b7f-adb7-14b5a7f2c493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:44.616652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8eb57-84e7-4b7f-adb7-14b5a7f2c493 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:44.616937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8eb57-84e7-4b7f-adb7-14b5a7f2c493 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:44.617218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8eb57-84e7-4b7f-adb7-14b5a7f2c493 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:44.617928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8eb57-84e7-4b7f-adb7-14b5a7f2c493 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:44.618224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8eb57-84e7-4b7f-adb7-14b5a7f2c493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:44.644104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8eb57-84e7-4b7f-adb7-14b5a7f2c493 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:44.653192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 344/689] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:40:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:44.658904 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bba89-54ee-473b-bac8-5fc0325c6462 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:44.669415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bba89-54ee-473b-bac8-5fc0325c6462 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:44.673423 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f9fa2-c834-4828-b14e-628d45e6c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:44.674124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f9fa2-c834-4828-b14e-628d45e6c305 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:44.674410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f9fa2-c834-4828-b14e-628d45e6c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:44.674691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f9fa2-c834-4828-b14e-628d45e6c305 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:44.685925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f9fa2-c834-4828-b14e-628d45e6c305 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:44.711780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f9fa2-c834-4828-b14e-628d45e6c305 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:44.730980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-271f9fa2-c834-4828-b14e-628d45e6c305 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:44.732137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 346/690] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:44.737736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8eb57-84e7-4b7f-adb7-14b5a7f2c493 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:44.747181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8eb57-84e7-4b7f-adb7-14b5a7f2c493 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:44.751252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235fe2-317c-416b-98ce-8227b3151946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:44.751815 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235fe2-317c-416b-98ce-8227b3151946 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:44.752132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235fe2-317c-416b-98ce-8227b3151946 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:44.752415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235fe2-317c-416b-98ce-8227b3151946 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:44.753099 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68235fe2-317c-416b-98ce-8227b3151946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:44.753399 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68235fe2-317c-416b-98ce-8227b3151946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:44.779139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68235fe2-317c-416b-98ce-8227b3151946 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:44.793205 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 345/691] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:44.798931 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f9fa2-c834-4828-b14e-628d45e6c305 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:44.809936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f9fa2-c834-4828-b14e-628d45e6c305 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:44.816734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06ad0c-2b00-473d-a71b-f2b0e4943ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:44.816734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06ad0c-2b00-473d-a71b-f2b0e4943ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:44.816734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06ad0c-2b00-473d-a71b-f2b0e4943ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:44.817040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06ad0c-2b00-473d-a71b-f2b0e4943ba5 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:44.831375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06ad0c-2b00-473d-a71b-f2b0e4943ba5 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:44.858765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06ad0c-2b00-473d-a71b-f2b0e4943ba5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:44.878261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-ab06ad0c-2b00-473d-a71b-f2b0e4943ba5 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 18 12:40:44.879408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 347/692] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:40:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:44.885744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235fe2-317c-416b-98ce-8227b3151946 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:44.895078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235fe2-317c-416b-98ce-8227b3151946 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:44.899194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9009d-eb57-4a98-968c-e22a16a2e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:44.899874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9009d-eb57-4a98-968c-e22a16a2e8cb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:44.900162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9009d-eb57-4a98-968c-e22a16a2e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:44.900444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9009d-eb57-4a98-968c-e22a16a2e8cb admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:44.901223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9009d-eb57-4a98-968c-e22a16a2e8cb admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:44.901525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9009d-eb57-4a98-968c-e22a16a2e8cb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:44.927727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9009d-eb57-4a98-968c-e22a16a2e8cb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:44.959324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 346/693] 10.222.0.87 () {56 vars in 1158 bytes} [Tue Jan 18 12:40:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:44.965308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06ad0c-2b00-473d-a71b-f2b0e4943ba5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:44.974599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06ad0c-2b00-473d-a71b-f2b0e4943ba5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:44.979280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529cd0d-04a3-4c76-a996-a66691203a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:44.979874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529cd0d-04a3-4c76-a996-a66691203a35 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:44.980156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529cd0d-04a3-4c76-a996-a66691203a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:44.980434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529cd0d-04a3-4c76-a996-a66691203a35 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:44.987935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529cd0d-04a3-4c76-a996-a66691203a35 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:45.014213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529cd0d-04a3-4c76-a996-a66691203a35 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:45.022843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 348/694] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:40:44 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:40:45.028840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9009d-eb57-4a98-968c-e22a16a2e8cb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:45.038321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9009d-eb57-4a98-968c-e22a16a2e8cb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:45.043094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6ea1-4721-4ec4-a4ad-d1b15eb1bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:45.043836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6ea1-4721-4ec4-a4ad-d1b15eb1bc5b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:45.044120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6ea1-4721-4ec4-a4ad-d1b15eb1bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:45.044397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be6ea1-4721-4ec4-a4ad-d1b15eb1bc5b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:45.057394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be6ea1-4721-4ec4-a4ad-d1b15eb1bc5b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:45.083991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be6ea1-4721-4ec4-a4ad-d1b15eb1bc5b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:45.157043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-e8be6ea1-4721-4ec4-a4ad-d1b15eb1bc5b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:45.157043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 347/695] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:45.157362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529cd0d-04a3-4c76-a996-a66691203a35 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:45.157362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529cd0d-04a3-4c76-a996-a66691203a35 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:45.157362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c8e5-47d6-4ed7-9c02-6228c420e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:45.157362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c8e5-47d6-4ed7-9c02-6228c420e663 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:45.157982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c8e5-47d6-4ed7-9c02-6228c420e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:45.157982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f78c8e5-47d6-4ed7-9c02-6228c420e663 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:45.157982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c8e5-47d6-4ed7-9c02-6228c420e663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:45.157982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c8e5-47d6-4ed7-9c02-6228c420e663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:45.158904 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f78c8e5-47d6-4ed7-9c02-6228c420e663 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:45.172642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 349/696] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:45.178182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6ea1-4721-4ec4-a4ad-d1b15eb1bc5b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:45.188316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be6ea1-4721-4ec4-a4ad-d1b15eb1bc5b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:45.192223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7aa7a-c05a-4186-a969-07265ea5dc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:45.192927 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7aa7a-c05a-4186-a969-07265ea5dc46 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:45.193210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7aa7a-c05a-4186-a969-07265ea5dc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:45.193485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7aa7a-c05a-4186-a969-07265ea5dc46 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:45.202640 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7aa7a-c05a-4186-a969-07265ea5dc46 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:45.228612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7aa7a-c05a-4186-a969-07265ea5dc46 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:45.242391 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-68d7aa7a-c05a-4186-a969-07265ea5dc46 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:45.244071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 348/697] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:45.249826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c8e5-47d6-4ed7-9c02-6228c420e663 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:45.259082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f78c8e5-47d6-4ed7-9c02-6228c420e663 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:45.263130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44944a0f-6fca-4eec-9fd5-9464ba4aeb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:45.263736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44944a0f-6fca-4eec-9fd5-9464ba4aeb53 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:45.264023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44944a0f-6fca-4eec-9fd5-9464ba4aeb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:45.264357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44944a0f-6fca-4eec-9fd5-9464ba4aeb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:45.265041 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44944a0f-6fca-4eec-9fd5-9464ba4aeb53 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:45.265341 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44944a0f-6fca-4eec-9fd5-9464ba4aeb53 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:45.291463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44944a0f-6fca-4eec-9fd5-9464ba4aeb53 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:45.304491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 350/698] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:45.311066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7aa7a-c05a-4186-a969-07265ea5dc46 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:45.320372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7aa7a-c05a-4186-a969-07265ea5dc46 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:45.324611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772d55-7d27-47e6-abf1-06c14124b655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:45.325173 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772d55-7d27-47e6-abf1-06c14124b655 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:45.325456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772d55-7d27-47e6-abf1-06c14124b655 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:45.325733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772d55-7d27-47e6-abf1-06c14124b655 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:45.326501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772d55-7d27-47e6-abf1-06c14124b655 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=f6fb4643e93c455c9eb828c52b68bbc3) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:45.326800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772d55-7d27-47e6-abf1-06c14124b655 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:45.354082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772d55-7d27-47e6-abf1-06c14124b655 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:45.360010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 349/699] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:40:45 2022] GET /identity/v3/role_assignments?user.id=f6fb4643e93c455c9eb828c52b68bbc3&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:47.335952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64028232-2ae1-460d-be31-9c4432bea489 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.336475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64028232-2ae1-460d-be31-9c4432bea489 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.336583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64028232-2ae1-460d-be31-9c4432bea489 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.338314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 351/700] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:47.343504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02ee8e-7b45-49ab-8182-f565fe936a70 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.343883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02ee8e-7b45-49ab-8182-f565fe936a70 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.344081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02ee8e-7b45-49ab-8182-f565fe936a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.367063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ce02ee8e-7b45-49ab-8182-f565fe936a70 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:47.368142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ce02ee8e-7b45-49ab-8182-f565fe936a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:47.375762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 350/701] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:47 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:47.397554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64028232-2ae1-460d-be31-9c4432bea489 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:47.409582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64028232-2ae1-460d-be31-9c4432bea489 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:47.413431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc2f40-6243-4b39-9ada-cdd13629e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:47.414185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc2f40-6243-4b39-9ada-cdd13629e6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.414497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc2f40-6243-4b39-9ada-cdd13629e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.414779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc2f40-6243-4b39-9ada-cdd13629e6b9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.426344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc2f40-6243-4b39-9ada-cdd13629e6b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:47.433425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-97dc2f40-6243-4b39-9ada-cdd13629e6b9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:40:47.434493 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 352/702] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:40:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:47.440370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02ee8e-7b45-49ab-8182-f565fe936a70 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:47.449185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02ee8e-7b45-49ab-8182-f565fe936a70 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:47.453178 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831984a-2857-4fcf-8a17-58a691404cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:47.453763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831984a-2857-4fcf-8a17-58a691404cfa admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.454046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831984a-2857-4fcf-8a17-58a691404cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.454324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831984a-2857-4fcf-8a17-58a691404cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.455023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831984a-2857-4fcf-8a17-58a691404cfa admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:47.455331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831984a-2857-4fcf-8a17-58a691404cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:47.481196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831984a-2857-4fcf-8a17-58a691404cfa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:47.489676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 351/703] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:40:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:47.496073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc2f40-6243-4b39-9ada-cdd13629e6b9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:47.506027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc2f40-6243-4b39-9ada-cdd13629e6b9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:47.510258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695030-3d4e-437b-a27a-6947ec4298f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:47.510995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695030-3d4e-437b-a27a-6947ec4298f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.511290 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695030-3d4e-437b-a27a-6947ec4298f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.511601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695030-3d4e-437b-a27a-6947ec4298f0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.522847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695030-3d4e-437b-a27a-6947ec4298f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:47.553829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695030-3d4e-437b-a27a-6947ec4298f0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:47.573025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-55695030-3d4e-437b-a27a-6947ec4298f0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:47.574132 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 353/704] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:40:47.579840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831984a-2857-4fcf-8a17-58a691404cfa admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:47.589886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831984a-2857-4fcf-8a17-58a691404cfa admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:47.594066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4c07-a6ae-4e48-80d8-8c17561e0400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:47.594644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4c07-a6ae-4e48-80d8-8c17561e0400 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.594937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4c07-a6ae-4e48-80d8-8c17561e0400 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.595218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4c07-a6ae-4e48-80d8-8c17561e0400 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.595939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4c07-a6ae-4e48-80d8-8c17561e0400 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:47.596241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4c07-a6ae-4e48-80d8-8c17561e0400 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:47.622687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d4c07-a6ae-4e48-80d8-8c17561e0400 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:47.635695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 352/705] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:47.641089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695030-3d4e-437b-a27a-6947ec4298f0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:47.650897 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695030-3d4e-437b-a27a-6947ec4298f0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:47.654922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed50892-4efe-4d9e-88e4-e57dc69806eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:47.655668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed50892-4efe-4d9e-88e4-e57dc69806eb admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.655962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed50892-4efe-4d9e-88e4-e57dc69806eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.656247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed50892-4efe-4d9e-88e4-e57dc69806eb admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.669559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed50892-4efe-4d9e-88e4-e57dc69806eb admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:47.695342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed50892-4efe-4d9e-88e4-e57dc69806eb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:47.714139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-9ed50892-4efe-4d9e-88e4-e57dc69806eb admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 18 12:40:47.715257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 354/706] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:40:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:47.720902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4c07-a6ae-4e48-80d8-8c17561e0400 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:47.730877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4c07-a6ae-4e48-80d8-8c17561e0400 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:47.734884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0d52b-8be8-4b79-ac24-d1b49b7658d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:47.735493 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0d52b-8be8-4b79-ac24-d1b49b7658d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.735778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0d52b-8be8-4b79-ac24-d1b49b7658d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.736053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0d52b-8be8-4b79-ac24-d1b49b7658d4 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.736831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0d52b-8be8-4b79-ac24-d1b49b7658d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:47.737133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0d52b-8be8-4b79-ac24-d1b49b7658d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:47.762432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0d52b-8be8-4b79-ac24-d1b49b7658d4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:47.792850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 353/707] 10.222.0.87 () {56 vars in 1158 bytes} [Tue Jan 18 12:40:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:47.798379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed50892-4efe-4d9e-88e4-e57dc69806eb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:47.808194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed50892-4efe-4d9e-88e4-e57dc69806eb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:47.812253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575fb19-cab1-49a6-9a31-e1b7a2edbbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:47.812960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575fb19-cab1-49a6-9a31-e1b7a2edbbaa admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.813253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575fb19-cab1-49a6-9a31-e1b7a2edbbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.813534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575fb19-cab1-49a6-9a31-e1b7a2edbbaa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.827239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575fb19-cab1-49a6-9a31-e1b7a2edbbaa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:47.853960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575fb19-cab1-49a6-9a31-e1b7a2edbbaa admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:47.871365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-8575fb19-cab1-49a6-9a31-e1b7a2edbbaa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:47.872485 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 355/708] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:47.878116 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0d52b-8be8-4b79-ac24-d1b49b7658d4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:47.887581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0d52b-8be8-4b79-ac24-d1b49b7658d4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:47.891662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1796fd3-de65-41b0-97cd-2d351a6a05a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:47.892252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1796fd3-de65-41b0-97cd-2d351a6a05a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.892543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1796fd3-de65-41b0-97cd-2d351a6a05a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.892828 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1796fd3-de65-41b0-97cd-2d351a6a05a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.893523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1796fd3-de65-41b0-97cd-2d351a6a05a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:47.893823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1796fd3-de65-41b0-97cd-2d351a6a05a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:47.921399 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1796fd3-de65-41b0-97cd-2d351a6a05a5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:47.933777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 354/709] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:47.939191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575fb19-cab1-49a6-9a31-e1b7a2edbbaa admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:47.948964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575fb19-cab1-49a6-9a31-e1b7a2edbbaa admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:47.953018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5bba4-7f02-4e14-9af0-5323a35cca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:47.953722 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5bba4-7f02-4e14-9af0-5323a35cca91 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:47.954011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5bba4-7f02-4e14-9af0-5323a35cca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:47.954295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5bba4-7f02-4e14-9af0-5323a35cca91 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:47.963709 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5bba4-7f02-4e14-9af0-5323a35cca91 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:47.989283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5bba4-7f02-4e14-9af0-5323a35cca91 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:48.002665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-53b5bba4-7f02-4e14-9af0-5323a35cca91 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:48.003750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 356/710] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:48.010602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1796fd3-de65-41b0-97cd-2d351a6a05a5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:48.019900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1796fd3-de65-41b0-97cd-2d351a6a05a5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:48.023925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16498b-ca87-4df5-b557-dd8e0e7def09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:48.024506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16498b-ca87-4df5-b557-dd8e0e7def09 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:48.024797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16498b-ca87-4df5-b557-dd8e0e7def09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:48.025965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16498b-ca87-4df5-b557-dd8e0e7def09 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:48.026490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16498b-ca87-4df5-b557-dd8e0e7def09 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:48.026898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16498b-ca87-4df5-b557-dd8e0e7def09 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:48.052661 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16498b-ca87-4df5-b557-dd8e0e7def09 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:48.066322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 355/711] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:48.073027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5bba4-7f02-4e14-9af0-5323a35cca91 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:48.082370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5bba4-7f02-4e14-9af0-5323a35cca91 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:48.086453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7041241-9718-4e01-bb8d-03a90cabbb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:48.087950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7041241-9718-4e01-bb8d-03a90cabbb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:48.088502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7041241-9718-4e01-bb8d-03a90cabbb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:48.088784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7041241-9718-4e01-bb8d-03a90cabbb4a admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/f6fb4643e93c455c9eb828c52b68bbc3/roles/021156a7816c4a96874e0a699028ceef` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:48.108428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7041241-9718-4e01-bb8d-03a90cabbb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=f6fb4643e93c455c9eb828c52b68bbc3, role_id=021156a7816c4a96874e0a699028ceef)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:48.135956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7041241-9718-4e01-bb8d-03a90cabbb4a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:48.267050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 357/712] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:40:48 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/f6fb4643e93c455c9eb828c52b68bbc3/roles/021156a7816c4a96874e0a699028ceef => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:40:50.244529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad3ff-867a-4160-8344-288822ba0a63 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.245233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad3ff-867a-4160-8344-288822ba0a63 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.245434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad3ff-867a-4160-8344-288822ba0a63 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.247680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 356/713] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:50.253187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e248e-9833-4b20-9a70-dedc4136a292 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.253659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e248e-9833-4b20-9a70-dedc4136a292 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.253747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e248e-9833-4b20-9a70-dedc4136a292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.277114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e47e248e-9833-4b20-9a70-dedc4136a292 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:50.278260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e47e248e-9833-4b20-9a70-dedc4136a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:50.342160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 358/714] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:50 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:40:50.365110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffad3ff-867a-4160-8344-288822ba0a63 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.376973 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffad3ff-867a-4160-8344-288822ba0a63 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.380977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de979e-4b05-4391-9e8f-1851222c5d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.381683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de979e-4b05-4391-9e8f-1851222c5d4e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.381970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de979e-4b05-4391-9e8f-1851222c5d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.382249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de979e-4b05-4391-9e8f-1851222c5d4e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.393963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de979e-4b05-4391-9e8f-1851222c5d4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:40:50.402137 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-61de979e-4b05-4391-9e8f-1851222c5d4e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:40:50.403348 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 357/715] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:50.413667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e248e-9833-4b20-9a70-dedc4136a292 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.423680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e248e-9833-4b20-9a70-dedc4136a292 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.427998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88bef3-628e-42f2-82f8-b773c5e77826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.428595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88bef3-628e-42f2-82f8-b773c5e77826 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.428881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88bef3-628e-42f2-82f8-b773c5e77826 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.429162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88bef3-628e-42f2-82f8-b773c5e77826 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.429858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88bef3-628e-42f2-82f8-b773c5e77826 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:50.430154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88bef3-628e-42f2-82f8-b773c5e77826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:50.459933 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88bef3-628e-42f2-82f8-b773c5e77826 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:50.469727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 359/716] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:50.475642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de979e-4b05-4391-9e8f-1851222c5d4e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.485564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de979e-4b05-4391-9e8f-1851222c5d4e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.489667 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41bbc4-a90b-4524-925f-24dc1df26083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.490373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41bbc4-a90b-4524-925f-24dc1df26083 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.490657 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41bbc4-a90b-4524-925f-24dc1df26083 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.490938 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41bbc4-a90b-4524-925f-24dc1df26083 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.502436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41bbc4-a90b-4524-925f-24dc1df26083 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:50.529055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41bbc4-a90b-4524-925f-24dc1df26083 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:50.547329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-7d41bbc4-a90b-4524-925f-24dc1df26083 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:50.548448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 358/717] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:50.554116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88bef3-628e-42f2-82f8-b773c5e77826 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.564041 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88bef3-628e-42f2-82f8-b773c5e77826 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.568095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca4c26-78a6-4f79-b065-d479f92ee28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.568684 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca4c26-78a6-4f79-b065-d479f92ee28c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.568962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca4c26-78a6-4f79-b065-d479f92ee28c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.569244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca4c26-78a6-4f79-b065-d479f92ee28c admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.569922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca4c26-78a6-4f79-b065-d479f92ee28c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:50.570221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca4c26-78a6-4f79-b065-d479f92ee28c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:50.596213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca4c26-78a6-4f79-b065-d479f92ee28c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:50.608863 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 360/718] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:50.614273 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41bbc4-a90b-4524-925f-24dc1df26083 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.624903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41bbc4-a90b-4524-925f-24dc1df26083 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.629015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ed7c-6264-45e4-bd49-743359d4dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.629730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ed7c-6264-45e4-bd49-743359d4dd41 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.630016 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ed7c-6264-45e4-bd49-743359d4dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.630308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5ed7c-6264-45e4-bd49-743359d4dd41 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.644097 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5ed7c-6264-45e4-bd49-743359d4dd41 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:50.670913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5ed7c-6264-45e4-bd49-743359d4dd41 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:50.689419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-7cc5ed7c-6264-45e4-bd49-743359d4dd41 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 18 12:40:50.690497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 359/719] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:50.696211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca4c26-78a6-4f79-b065-d479f92ee28c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.706519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca4c26-78a6-4f79-b065-d479f92ee28c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.710701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375127f-3141-47ed-b3c6-2e4a9828f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.711292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375127f-3141-47ed-b3c6-2e4a9828f391 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.711606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375127f-3141-47ed-b3c6-2e4a9828f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.711958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6375127f-3141-47ed-b3c6-2e4a9828f391 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.712964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375127f-3141-47ed-b3c6-2e4a9828f391 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:50.713453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375127f-3141-47ed-b3c6-2e4a9828f391 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:50.739762 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6375127f-3141-47ed-b3c6-2e4a9828f391 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:50.772122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 361/720] 10.222.0.87 () {56 vars in 1158 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:50.778003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ed7c-6264-45e4-bd49-743359d4dd41 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.787634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5ed7c-6264-45e4-bd49-743359d4dd41 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.792136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335a6d2-caa5-4279-aa4a-bdb4eb0177e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.792728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a6d2-caa5-4279-aa4a-bdb4eb0177e5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.793014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a6d2-caa5-4279-aa4a-bdb4eb0177e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.793292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a6d2-caa5-4279-aa4a-bdb4eb0177e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.800886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335a6d2-caa5-4279-aa4a-bdb4eb0177e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:50.828407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335a6d2-caa5-4279-aa4a-bdb4eb0177e5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:50.836960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 360/721] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/auth/tokens => generated 1861 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:40:50.843464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375127f-3141-47ed-b3c6-2e4a9828f391 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.852744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6375127f-3141-47ed-b3c6-2e4a9828f391 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.857332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477472-99fe-42e9-a81e-2142e54222a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.858038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477472-99fe-42e9-a81e-2142e54222a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.858327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477472-99fe-42e9-a81e-2142e54222a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.858606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55477472-99fe-42e9-a81e-2142e54222a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.870124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55477472-99fe-42e9-a81e-2142e54222a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:50.895626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55477472-99fe-42e9-a81e-2142e54222a0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:50.913317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-55477472-99fe-42e9-a81e-2142e54222a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:40:50.914384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 362/722] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:50.920996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335a6d2-caa5-4279-aa4a-bdb4eb0177e5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.929406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335a6d2-caa5-4279-aa4a-bdb4eb0177e5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.933518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b09914-a804-44e0-9708-22eabd86b46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.934095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b09914-a804-44e0-9708-22eabd86b46d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.934382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b09914-a804-44e0-9708-22eabd86b46d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.934834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b09914-a804-44e0-9708-22eabd86b46d admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:50.935352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b09914-a804-44e0-9708-22eabd86b46d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:50.935656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b09914-a804-44e0-9708-22eabd86b46d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:50.961197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b09914-a804-44e0-9708-22eabd86b46d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:50.976353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 361/723] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:50.982005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477472-99fe-42e9-a81e-2142e54222a0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:50.991201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55477472-99fe-42e9-a81e-2142e54222a0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:50.995456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75e1ad-c49e-4e5f-9f30-d054da8cad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:50.996159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75e1ad-c49e-4e5f-9f30-d054da8cad02 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:50.996446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75e1ad-c49e-4e5f-9f30-d054da8cad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:50.996723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75e1ad-c49e-4e5f-9f30-d054da8cad02 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:51.005633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75e1ad-c49e-4e5f-9f30-d054da8cad02 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:51.032445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75e1ad-c49e-4e5f-9f30-d054da8cad02 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:51.046406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-0d75e1ad-c49e-4e5f-9f30-d054da8cad02 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:40:51.047534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 363/724] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:40:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:40:51.053164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b09914-a804-44e0-9708-22eabd86b46d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:51.062984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b09914-a804-44e0-9708-22eabd86b46d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:51.067082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca034a3-861e-4b8a-958c-0473540c5051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:51.067777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca034a3-861e-4b8a-958c-0473540c5051 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:51.068134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca034a3-861e-4b8a-958c-0473540c5051 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:51.068485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca034a3-861e-4b8a-958c-0473540c5051 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:51.069292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca034a3-861e-4b8a-958c-0473540c5051 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:51.069664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca034a3-861e-4b8a-958c-0473540c5051 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:51.097091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca034a3-861e-4b8a-958c-0473540c5051 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:51.110887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 362/725] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:51.116974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75e1ad-c49e-4e5f-9f30-d054da8cad02 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:51.126307 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75e1ad-c49e-4e5f-9f30-d054da8cad02 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:51.130494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a2ffa-87ce-429d-952f-f224ba9980e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:51.131081 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2ffa-87ce-429d-952f-f224ba9980e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:51.131406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2ffa-87ce-429d-952f-f224ba9980e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:51.131691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a2ffa-87ce-429d-952f-f224ba9980e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:51.132470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2ffa-87ce-429d-952f-f224ba9980e7 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=f6fb4643e93c455c9eb828c52b68bbc3) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:51.132774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2ffa-87ce-429d-952f-f224ba9980e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:51.161335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a2ffa-87ce-429d-952f-f224ba9980e7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:51.168027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 364/726] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:40:51 2022] GET /identity/v3/role_assignments?user.id=f6fb4643e93c455c9eb828c52b68bbc3&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:53.392954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ca2fe-4c19-423e-829e-890792ee7caf None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:53.393455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ca2fe-4c19-423e-829e-890792ee7caf None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:53.393455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ca2fe-4c19-423e-829e-890792ee7caf None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:53.395115 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 363/727] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:53.400060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926cd76-bcdf-48ad-9506-e1a5f463523f None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:53.401136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926cd76-bcdf-48ad-9506-e1a5f463523f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:53.401256 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926cd76-bcdf-48ad-9506-e1a5f463523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:53.424468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1926cd76-bcdf-48ad-9506-e1a5f463523f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:53.425574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1926cd76-bcdf-48ad-9506-e1a5f463523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:53.432495 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 365/728] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:53 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:53.454818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ca2fe-4c19-423e-829e-890792ee7caf None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:53.466887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ca2fe-4c19-423e-829e-890792ee7caf None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:53.470787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f187e-92c6-4b51-9bdd-37582a27b42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:53.471537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f187e-92c6-4b51-9bdd-37582a27b42e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:53.471822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f187e-92c6-4b51-9bdd-37582a27b42e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:53.472100 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f187e-92c6-4b51-9bdd-37582a27b42e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:53.472717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f187e-92c6-4b51-9bdd-37582a27b42e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:53.498285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f187e-92c6-4b51-9bdd-37582a27b42e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:53.509299 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-600f187e-92c6-4b51-9bdd-37582a27b42e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 18 12:40:53.510952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 364/729] 10.222.0.87 () {56 vars in 1150 bytes} [Tue Jan 18 12:40:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:53.516885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926cd76-bcdf-48ad-9506-e1a5f463523f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:53.526563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926cd76-bcdf-48ad-9506-e1a5f463523f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:53.530713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20eedd-3894-4a70-9a0c-7d4439ad85f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:53.531294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20eedd-3894-4a70-9a0c-7d4439ad85f6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:53.531609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20eedd-3894-4a70-9a0c-7d4439ad85f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:53.531893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20eedd-3894-4a70-9a0c-7d4439ad85f6 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:53.532566 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20eedd-3894-4a70-9a0c-7d4439ad85f6 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:53.532864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20eedd-3894-4a70-9a0c-7d4439ad85f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:53.559838 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20eedd-3894-4a70-9a0c-7d4439ad85f6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:53.564554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 366/730] 10.222.0.87 () {56 vars in 1145 bytes} [Tue Jan 18 12:40:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:40:53.570049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f187e-92c6-4b51-9bdd-37582a27b42e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:53.579941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f187e-92c6-4b51-9bdd-37582a27b42e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:53.583981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8274ce0-abc1-4199-b31b-e20c433b791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:53.584559 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274ce0-abc1-4199-b31b-e20c433b791c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:53.584843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274ce0-abc1-4199-b31b-e20c433b791c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:53.585121 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8274ce0-abc1-4199-b31b-e20c433b791c admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:53.585785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8274ce0-abc1-4199-b31b-e20c433b791c admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:53.586081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8274ce0-abc1-4199-b31b-e20c433b791c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:53.618594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8274ce0-abc1-4199-b31b-e20c433b791c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:53.625555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 365/731] 10.222.0.87 () {56 vars in 1145 bytes} [Tue Jan 18 12:40:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:55.583130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e58364-5e2a-47ba-bd3c-e9c3c30f22bb None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:55.583684 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e58364-5e2a-47ba-bd3c-e9c3c30f22bb None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:55.583846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e58364-5e2a-47ba-bd3c-e9c3c30f22bb None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:55.585394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 367/732] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:55.591130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8c19-b3d1-4b5c-b364-a71c6a6ba9be None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:55.591580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8c19-b3d1-4b5c-b364-a71c6a6ba9be None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:55.591874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8c19-b3d1-4b5c-b364-a71c6a6ba9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:55.614714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f10b8c19-b3d1-4b5c-b364-a71c6a6ba9be None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:55.615865 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f10b8c19-b3d1-4b5c-b364-a71c6a6ba9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:55.624214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 366/733] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:55 2022] POST /identity/v3/auth/tokens => generated 1861 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:40:55.649012 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e58364-5e2a-47ba-bd3c-e9c3c30f22bb None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:55.661778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e58364-5e2a-47ba-bd3c-e9c3c30f22bb None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:55.665683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50463b46-ffbc-4d9d-9c2a-d634a6d133c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:55.666955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463b46-ffbc-4d9d-9c2a-d634a6d133c2 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:55.667250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463b46-ffbc-4d9d-9c2a-d634a6d133c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:55.667561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50463b46-ffbc-4d9d-9c2a-d634a6d133c2 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:55.668226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50463b46-ffbc-4d9d-9c2a-d634a6d133c2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:55.694247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50463b46-ffbc-4d9d-9c2a-d634a6d133c2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:55.770556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 368/734] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:40:55 2022] POST /identity/v3/services => generated 251 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:40:57.779813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c33df8-2bbe-4ab9-bb3d-85923e9f84fd None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:57.780360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c33df8-2bbe-4ab9-bb3d-85923e9f84fd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:57.780360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c33df8-2bbe-4ab9-bb3d-85923e9f84fd None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:57.782045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 367/735] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:40:57.787517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953555-e117-49d1-a367-094d8ea96cab None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:57.787898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953555-e117-49d1-a367-094d8ea96cab None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:57.788082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953555-e117-49d1-a367-094d8ea96cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:57.813147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c9953555-e117-49d1-a367-094d8ea96cab None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:40:57.814250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c9953555-e117-49d1-a367-094d8ea96cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:40:57.830646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 369/736] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:40:57 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:40:57.854369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c33df8-2bbe-4ab9-bb3d-85923e9f84fd None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:57.867334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c33df8-2bbe-4ab9-bb3d-85923e9f84fd None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:57.871955 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce651-1667-41a2-97ea-ee6c02070bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:57.872729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce651-1667-41a2-97ea-ee6c02070bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:57.873019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce651-1667-41a2-97ea-ee6c02070bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:57.873303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfce651-1667-41a2-97ea-ee6c02070bd3 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:57.873928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfce651-1667-41a2-97ea-ee6c02070bd3 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:57.899838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfce651-1667-41a2-97ea-ee6c02070bd3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:57.910936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-9cfce651-1667-41a2-97ea-ee6c02070bd3 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 18 12:40:57.912019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 368/737] 10.222.0.87 () {56 vars in 1150 bytes} [Tue Jan 18 12:40:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:40:57.918952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953555-e117-49d1-a367-094d8ea96cab None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:57.927098 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953555-e117-49d1-a367-094d8ea96cab None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:57.931197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc3255-8fb8-4da6-9416-bbdba1b1454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:57.931812 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc3255-8fb8-4da6-9416-bbdba1b1454c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:57.932736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc3255-8fb8-4da6-9416-bbdba1b1454c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:57.933107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc3255-8fb8-4da6-9416-bbdba1b1454c admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:57.933776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc3255-8fb8-4da6-9416-bbdba1b1454c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:57.934075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc3255-8fb8-4da6-9416-bbdba1b1454c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:57.959258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc3255-8fb8-4da6-9416-bbdba1b1454c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:57.963853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 370/738] 10.222.0.87 () {56 vars in 1145 bytes} [Tue Jan 18 12:40:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:57.969343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce651-1667-41a2-97ea-ee6c02070bd3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:57.978613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfce651-1667-41a2-97ea-ee6c02070bd3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:57.983116 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73cac3-e245-4fb0-9bef-c4564e6b69b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:57.983733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73cac3-e245-4fb0-9bef-c4564e6b69b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:57.984027 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73cac3-e245-4fb0-9bef-c4564e6b69b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:57.984312 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73cac3-e245-4fb0-9bef-c4564e6b69b2 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:57.984979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73cac3-e245-4fb0-9bef-c4564e6b69b2 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:57.985279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73cac3-e245-4fb0-9bef-c4564e6b69b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:58.011205 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73cac3-e245-4fb0-9bef-c4564e6b69b2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:58.016201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 369/739] 10.222.0.87 () {56 vars in 1145 bytes} [Tue Jan 18 12:40:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:58.021727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc3255-8fb8-4da6-9416-bbdba1b1454c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:58.031020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc3255-8fb8-4da6-9416-bbdba1b1454c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:58.035283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708e584-77c3-45fa-9d27-3d0b18e8165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:58.035877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708e584-77c3-45fa-9d27-3d0b18e8165c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:58.036167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708e584-77c3-45fa-9d27-3d0b18e8165c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:58.036447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708e584-77c3-45fa-9d27-3d0b18e8165c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:58.037183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708e584-77c3-45fa-9d27-3d0b18e8165c admin admin] RBAC: Adding query filter params (interface=public, service_id=9a1016a84fa24ef58c3834ad9b3b90b3, region_id=RegionOne) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:40:58.037490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708e584-77c3-45fa-9d27-3d0b18e8165c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:58.064137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708e584-77c3-45fa-9d27-3d0b18e8165c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:58.069646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 371/740] 10.222.0.87 () {56 vars in 1272 bytes} [Tue Jan 18 12:40:58 2022] GET /identity/v3/endpoints?service_id=9a1016a84fa24ef58c3834ad9b3b90b3&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:40:58.075055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73cac3-e245-4fb0-9bef-c4564e6b69b2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:40:58.084582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73cac3-e245-4fb0-9bef-c4564e6b69b2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:40:58.089370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b34572-1c6e-41b8-a271-a1e63802e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:40:58.089787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34572-1c6e-41b8-a271-a1e63802e371 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:40:58.090075 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34572-1c6e-41b8-a271-a1e63802e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:40:58.090359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b34572-1c6e-41b8-a271-a1e63802e371 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:40:58.091015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b34572-1c6e-41b8-a271-a1e63802e371 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:40:58.116847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b34572-1c6e-41b8-a271-a1e63802e371 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:40:58.122874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 370/741] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:40:58 2022] GET /identity/v3/services => generated 1261 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 12:41:00.116966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a5960-ab42-40bf-a00c-9123e33e57f8 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:00.117424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a5960-ab42-40bf-a00c-9123e33e57f8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:00.117529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a5960-ab42-40bf-a00c-9123e33e57f8 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:00.119219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 372/742] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:00.125031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39154-b47e-4c72-a63b-667868a041f2 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:00.125472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39154-b47e-4c72-a63b-667868a041f2 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:00.125583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb39154-b47e-4c72-a63b-667868a041f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:00.147535 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1fb39154-b47e-4c72-a63b-667868a041f2 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:00.148652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1fb39154-b47e-4c72-a63b-667868a041f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:00.157410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 371/743] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:00 2022] POST /identity/v3/auth/tokens => generated 1965 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:00.180433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a5960-ab42-40bf-a00c-9123e33e57f8 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:00.193013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a5960-ab42-40bf-a00c-9123e33e57f8 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:00.196901 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc206b22-6f35-4055-a6ba-3b6de209dbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:00.197614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc206b22-6f35-4055-a6ba-3b6de209dbcc admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:00.198004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc206b22-6f35-4055-a6ba-3b6de209dbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:00.198279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc206b22-6f35-4055-a6ba-3b6de209dbcc admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:00.198886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc206b22-6f35-4055-a6ba-3b6de209dbcc admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:00.225584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc206b22-6f35-4055-a6ba-3b6de209dbcc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:00.237717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-cc206b22-6f35-4055-a6ba-3b6de209dbcc admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 18 12:41:00.238806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 373/744] 10.222.0.87 () {56 vars in 1150 bytes} [Tue Jan 18 12:41:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:00.245546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39154-b47e-4c72-a63b-667868a041f2 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:00.254969 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb39154-b47e-4c72-a63b-667868a041f2 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:00.259114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01f3b1-d8b6-44ea-b9a9-8ae6cf060098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:00.259766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01f3b1-d8b6-44ea-b9a9-8ae6cf060098 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:00.260060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01f3b1-d8b6-44ea-b9a9-8ae6cf060098 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:00.260450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01f3b1-d8b6-44ea-b9a9-8ae6cf060098 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:00.261751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01f3b1-d8b6-44ea-b9a9-8ae6cf060098 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:00.262063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01f3b1-d8b6-44ea-b9a9-8ae6cf060098 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:00.295721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01f3b1-d8b6-44ea-b9a9-8ae6cf060098 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:00.301025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 372/745] 10.222.0.87 () {56 vars in 1145 bytes} [Tue Jan 18 12:41:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:00.306849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc206b22-6f35-4055-a6ba-3b6de209dbcc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:00.316891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc206b22-6f35-4055-a6ba-3b6de209dbcc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:00.320956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07935695-2aa1-48b2-8a96-79714d2d744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:00.321537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07935695-2aa1-48b2-8a96-79714d2d744f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:00.321822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07935695-2aa1-48b2-8a96-79714d2d744f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:00.322102 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07935695-2aa1-48b2-8a96-79714d2d744f admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:00.322765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07935695-2aa1-48b2-8a96-79714d2d744f admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:00.323137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07935695-2aa1-48b2-8a96-79714d2d744f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:00.349201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07935695-2aa1-48b2-8a96-79714d2d744f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:00.354580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 374/746] 10.222.0.87 () {56 vars in 1145 bytes} [Tue Jan 18 12:41:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:00.360499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01f3b1-d8b6-44ea-b9a9-8ae6cf060098 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:00.370852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01f3b1-d8b6-44ea-b9a9-8ae6cf060098 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:00.374862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc33918-bd17-4a4b-93c2-227580373db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:00.375470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc33918-bd17-4a4b-93c2-227580373db8 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:00.375757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc33918-bd17-4a4b-93c2-227580373db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:00.376037 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc33918-bd17-4a4b-93c2-227580373db8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:00.376723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc33918-bd17-4a4b-93c2-227580373db8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:00.404713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc33918-bd17-4a4b-93c2-227580373db8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:00.519868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 373/747] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:41:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:41:02.517876 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0a86-3942-48f4-8a27-83618e538b07 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:02.518418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0a86-3942-48f4-8a27-83618e538b07 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:02.518418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c0a86-3942-48f4-8a27-83618e538b07 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:02.520143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 375/748] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:02.525231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429abacb-b968-4bc8-bf8f-8b0da1b22f65 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:02.525668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429abacb-b968-4bc8-bf8f-8b0da1b22f65 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:02.525795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429abacb-b968-4bc8-bf8f-8b0da1b22f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:02.549062 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-429abacb-b968-4bc8-bf8f-8b0da1b22f65 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:02.550170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-429abacb-b968-4bc8-bf8f-8b0da1b22f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:02.567487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 374/749] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:02 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:02.590049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c0a86-3942-48f4-8a27-83618e538b07 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:02.601609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c0a86-3942-48f4-8a27-83618e538b07 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:02.605641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eceaeb4-e8ce-408e-9f75-95206375c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:02.606346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceaeb4-e8ce-408e-9f75-95206375c091 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:02.606630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceaeb4-e8ce-408e-9f75-95206375c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:02.606905 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceaeb4-e8ce-408e-9f75-95206375c091 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:02.607553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eceaeb4-e8ce-408e-9f75-95206375c091 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:02.633304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eceaeb4-e8ce-408e-9f75-95206375c091 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:02.644412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-7eceaeb4-e8ce-408e-9f75-95206375c091 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Jan 18 12:41:02.645475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 376/750] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:02 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:41:02.651643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429abacb-b968-4bc8-bf8f-8b0da1b22f65 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:02.660494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429abacb-b968-4bc8-bf8f-8b0da1b22f65 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:02.664562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc34c6-2848-48d4-b05b-e4c2b0f7ceeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:02.665145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc34c6-2848-48d4-b05b-e4c2b0f7ceeb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:02.665431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc34c6-2848-48d4-b05b-e4c2b0f7ceeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:02.665713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc34c6-2848-48d4-b05b-e4c2b0f7ceeb admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:02.666383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc34c6-2848-48d4-b05b-e4c2b0f7ceeb admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:02.666703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc34c6-2848-48d4-b05b-e4c2b0f7ceeb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:02.693120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc34c6-2848-48d4-b05b-e4c2b0f7ceeb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:02.697592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 375/751] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:02 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:02.703711 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eceaeb4-e8ce-408e-9f75-95206375c091 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:02.714078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eceaeb4-e8ce-408e-9f75-95206375c091 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:02.718153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c982741-34a2-4f71-8ffc-8c4aa54026a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:02.718726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982741-34a2-4f71-8ffc-8c4aa54026a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:02.719015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982741-34a2-4f71-8ffc-8c4aa54026a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:02.719294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c982741-34a2-4f71-8ffc-8c4aa54026a3 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:02.719975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c982741-34a2-4f71-8ffc-8c4aa54026a3 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:02.720282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c982741-34a2-4f71-8ffc-8c4aa54026a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:02.746374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c982741-34a2-4f71-8ffc-8c4aa54026a3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:02.751179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 377/752] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:02 2022] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:04.730631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc536d-7f75-4fa9-b1f6-d310fd0915bb None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:04.731133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc536d-7f75-4fa9-b1f6-d310fd0915bb None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:04.731222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc536d-7f75-4fa9-b1f6-d310fd0915bb None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:04.732923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 376/753] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:04.739010 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab93e-eeb1-4199-84b6-f8c7a9e9a734 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:04.739519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab93e-eeb1-4199-84b6-f8c7a9e9a734 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:04.739617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab93e-eeb1-4199-84b6-f8c7a9e9a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:04.763219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-cadab93e-eeb1-4199-84b6-f8c7a9e9a734 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:04.764807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cadab93e-eeb1-4199-84b6-f8c7a9e9a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:04.773664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 378/754] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:04 2022] POST /identity/v3/auth/tokens => generated 2151 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:04.794989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc536d-7f75-4fa9-b1f6-d310fd0915bb None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:04.808023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc536d-7f75-4fa9-b1f6-d310fd0915bb None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:04.812623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e223c-8020-465b-8b0a-989f70b45cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:04.813211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e223c-8020-465b-8b0a-989f70b45cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:04.813505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e223c-8020-465b-8b0a-989f70b45cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:04.813787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e223c-8020-465b-8b0a-989f70b45cd5 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:04.814474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e223c-8020-465b-8b0a-989f70b45cd5 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:04.841351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e223c-8020-465b-8b0a-989f70b45cd5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:04.984196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 377/755] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:41:04 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:41:07.000203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e6da-b1db-4c59-b365-53ad34776a9c None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:07.000735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e6da-b1db-4c59-b365-53ad34776a9c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:07.000847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78e6da-b1db-4c59-b365-53ad34776a9c None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:07.002429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 379/756] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:07.007451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9eec0-96ff-4b7e-a213-81e38040a249 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:07.007846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9eec0-96ff-4b7e-a213-81e38040a249 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:07.008007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9eec0-96ff-4b7e-a213-81e38040a249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:07.030369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-83e9eec0-96ff-4b7e-a213-81e38040a249 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:07.031501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-83e9eec0-96ff-4b7e-a213-81e38040a249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:07.048692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 378/757] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:07 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:07.070874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e6da-b1db-4c59-b365-53ad34776a9c None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:07.083628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78e6da-b1db-4c59-b365-53ad34776a9c None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:07.087597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903bff-2699-4735-8bf6-e06daad4c976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:07.088850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903bff-2699-4735-8bf6-e06daad4c976 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:07.088850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903bff-2699-4735-8bf6-e06daad4c976 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:07.089691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6903bff-2699-4735-8bf6-e06daad4c976 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:07.090079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6903bff-2699-4735-8bf6-e06daad4c976 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:07.115896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6903bff-2699-4735-8bf6-e06daad4c976 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:07.126907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-e6903bff-2699-4735-8bf6-e06daad4c976 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Jan 18 12:41:07.128049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 380/758] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:07 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:07.134082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9eec0-96ff-4b7e-a213-81e38040a249 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:07.143525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9eec0-96ff-4b7e-a213-81e38040a249 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:07.147643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4f7b-9617-439f-86c2-b198e3152f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:07.148227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4f7b-9617-439f-86c2-b198e3152f58 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:07.148514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4f7b-9617-439f-86c2-b198e3152f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:07.148794 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4f7b-9617-439f-86c2-b198e3152f58 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:07.149465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f4f7b-9617-439f-86c2-b198e3152f58 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:07.149763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f4f7b-9617-439f-86c2-b198e3152f58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:07.176125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f4f7b-9617-439f-86c2-b198e3152f58 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:07.180797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 379/759] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:07 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:07.187814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903bff-2699-4735-8bf6-e06daad4c976 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:07.197099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6903bff-2699-4735-8bf6-e06daad4c976 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:07.202004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605d089-a791-4a30-b850-efbb47fc0886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:07.202573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605d089-a791-4a30-b850-efbb47fc0886 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:07.202856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605d089-a791-4a30-b850-efbb47fc0886 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:07.203130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605d089-a791-4a30-b850-efbb47fc0886 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:07.203821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605d089-a791-4a30-b850-efbb47fc0886 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:07.204117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605d089-a791-4a30-b850-efbb47fc0886 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:07.230326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605d089-a791-4a30-b850-efbb47fc0886 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:07.236983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 381/760] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:07 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:07.243068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4f7b-9617-439f-86c2-b198e3152f58 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:07.253792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4f7b-9617-439f-86c2-b198e3152f58 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:07.257778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc1c18-df13-4834-8625-012f77d7ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:07.258361 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc1c18-df13-4834-8625-012f77d7ea78 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:07.258645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc1c18-df13-4834-8625-012f77d7ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:07.258923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc1c18-df13-4834-8625-012f77d7ea78 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:07.259705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc1c18-df13-4834-8625-012f77d7ea78 admin admin] RBAC: Adding query filter params (interface=public, service_id=562a8e52cbd14d49850f11d327190d51, region_id=RegionOne) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:07.260008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc1c18-df13-4834-8625-012f77d7ea78 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:07.286876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc1c18-df13-4834-8625-012f77d7ea78 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:07.293031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 380/761] 10.222.0.87 () {56 vars in 1272 bytes} [Tue Jan 18 12:41:07 2022] GET /identity/v3/endpoints?service_id=562a8e52cbd14d49850f11d327190d51&interface=public®ion_id=RegionOne => generated 194 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:07.298752 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605d089-a791-4a30-b850-efbb47fc0886 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:07.308810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605d089-a791-4a30-b850-efbb47fc0886 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:07.312889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf1e61-fd36-4084-a1f9-3e5fa5076265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:07.313470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf1e61-fd36-4084-a1f9-3e5fa5076265 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:07.313759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf1e61-fd36-4084-a1f9-3e5fa5076265 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:07.314042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf1e61-fd36-4084-a1f9-3e5fa5076265 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:07.314687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf1e61-fd36-4084-a1f9-3e5fa5076265 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:07.339877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf1e61-fd36-4084-a1f9-3e5fa5076265 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:07.345792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 382/762] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:41:07 2022] GET /identity/v3/services => generated 1500 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 12:41:09.344172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bde615-4deb-4c6d-8575-cd15ce2427a2 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:09.344690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bde615-4deb-4c6d-8575-cd15ce2427a2 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:09.344690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bde615-4deb-4c6d-8575-cd15ce2427a2 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:09.346386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 381/763] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:09.352269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b011d-b4aa-4c9b-b7b8-b00b7a69eb06 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:09.352806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b011d-b4aa-4c9b-b7b8-b00b7a69eb06 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:09.352893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b011d-b4aa-4c9b-b7b8-b00b7a69eb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:09.376942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b91b011d-b4aa-4c9b-b7b8-b00b7a69eb06 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:09.378095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b91b011d-b4aa-4c9b-b7b8-b00b7a69eb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:09.385147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 383/764] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:09 2022] POST /identity/v3/auth/tokens => generated 2252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:09.407731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bde615-4deb-4c6d-8575-cd15ce2427a2 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:09.421267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bde615-4deb-4c6d-8575-cd15ce2427a2 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:09.425422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca13b03-6a3f-4844-b8bb-9cd5f3c04472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:09.426167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca13b03-6a3f-4844-b8bb-9cd5f3c04472 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:09.426458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca13b03-6a3f-4844-b8bb-9cd5f3c04472 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:09.426742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca13b03-6a3f-4844-b8bb-9cd5f3c04472 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:09.427415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca13b03-6a3f-4844-b8bb-9cd5f3c04472 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:09.454740 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca13b03-6a3f-4844-b8bb-9cd5f3c04472 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:09.466391 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-8ca13b03-6a3f-4844-b8bb-9cd5f3c04472 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Jan 18 12:41:09.467611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 382/765] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:09 2022] GET /identity/v3/services/volumev2 => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:41:09.473847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b011d-b4aa-4c9b-b7b8-b00b7a69eb06 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:09.483765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b011d-b4aa-4c9b-b7b8-b00b7a69eb06 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:09.487986 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a8df4-5809-459a-9627-f8b3cf4176da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:09.488626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a8df4-5809-459a-9627-f8b3cf4176da admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:09.488935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a8df4-5809-459a-9627-f8b3cf4176da admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:09.489196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a8df4-5809-459a-9627-f8b3cf4176da admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:09.489891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a8df4-5809-459a-9627-f8b3cf4176da admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:09.490190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a8df4-5809-459a-9627-f8b3cf4176da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:09.517051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8a8df4-5809-459a-9627-f8b3cf4176da admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:09.522426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 384/766] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:09 2022] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:09.529191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca13b03-6a3f-4844-b8bb-9cd5f3c04472 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:09.539436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca13b03-6a3f-4844-b8bb-9cd5f3c04472 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:09.544365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad450b-11ed-4bfc-b3df-746a247167cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:09.544985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad450b-11ed-4bfc-b3df-746a247167cc admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:09.545273 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad450b-11ed-4bfc-b3df-746a247167cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:09.545594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad450b-11ed-4bfc-b3df-746a247167cc admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:09.546290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad450b-11ed-4bfc-b3df-746a247167cc admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:09.546591 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad450b-11ed-4bfc-b3df-746a247167cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:09.573720 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad450b-11ed-4bfc-b3df-746a247167cc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:09.579611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 383/767] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:09 2022] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:09.585320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a8df4-5809-459a-9627-f8b3cf4176da admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:09.595384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a8df4-5809-459a-9627-f8b3cf4176da admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:09.599488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731cdd3-fa95-4638-8ce4-7ed83b5544aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:09.600083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731cdd3-fa95-4638-8ce4-7ed83b5544aa admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:09.600371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731cdd3-fa95-4638-8ce4-7ed83b5544aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:09.600652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731cdd3-fa95-4638-8ce4-7ed83b5544aa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:09.601358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731cdd3-fa95-4638-8ce4-7ed83b5544aa admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:09.628487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731cdd3-fa95-4638-8ce4-7ed83b5544aa admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:09.709916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 385/768] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:41:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:41:11.796243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb7c0-64ac-46f0-9e4f-576129a808f4 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:11.796873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb7c0-64ac-46f0-9e4f-576129a808f4 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:11.796873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001fb7c0-64ac-46f0-9e4f-576129a808f4 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:11.798527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 384/769] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:11.803562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb8675-4e9e-4368-9150-5b3f1e649a38 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:11.804008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb8675-4e9e-4368-9150-5b3f1e649a38 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:11.804169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb8675-4e9e-4368-9150-5b3f1e649a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:11.827359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c0eb8675-4e9e-4368-9150-5b3f1e649a38 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:11.828506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c0eb8675-4e9e-4368-9150-5b3f1e649a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:11.845294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 386/770] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:11 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:11.867064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb7c0-64ac-46f0-9e4f-576129a808f4 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:11.881845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001fb7c0-64ac-46f0-9e4f-576129a808f4 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:11.885783 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac385de-7aaa-4b5d-bdc4-aa250406c40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:11.886600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac385de-7aaa-4b5d-bdc4-aa250406c40f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:11.886885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac385de-7aaa-4b5d-bdc4-aa250406c40f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:11.887163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac385de-7aaa-4b5d-bdc4-aa250406c40f admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:11.887827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac385de-7aaa-4b5d-bdc4-aa250406c40f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:11.913871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac385de-7aaa-4b5d-bdc4-aa250406c40f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:11.925586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-6ac385de-7aaa-4b5d-bdc4-aa250406c40f admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 18 12:41:11.926715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 385/771] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:11.932838 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb8675-4e9e-4368-9150-5b3f1e649a38 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:11.942207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb8675-4e9e-4368-9150-5b3f1e649a38 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:11.946422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee388d-4951-4f17-8803-e0e7d11ebd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:11.947112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee388d-4951-4f17-8803-e0e7d11ebd1a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:11.947427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee388d-4951-4f17-8803-e0e7d11ebd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:11.947709 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee388d-4951-4f17-8803-e0e7d11ebd1a admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:11.948369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee388d-4951-4f17-8803-e0e7d11ebd1a admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:11.949116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee388d-4951-4f17-8803-e0e7d11ebd1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:11.975319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee388d-4951-4f17-8803-e0e7d11ebd1a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:11.981253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 387/772] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:11.987050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac385de-7aaa-4b5d-bdc4-aa250406c40f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:11.997506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac385de-7aaa-4b5d-bdc4-aa250406c40f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:12.001557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e0b4b-587c-40d0-ac5d-5baacc722c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:12.002143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e0b4b-587c-40d0-ac5d-5baacc722c2f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:12.002434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e0b4b-587c-40d0-ac5d-5baacc722c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:12.002724 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e0b4b-587c-40d0-ac5d-5baacc722c2f admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:12.003490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e0b4b-587c-40d0-ac5d-5baacc722c2f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:12.003797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e0b4b-587c-40d0-ac5d-5baacc722c2f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:12.029550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e0b4b-587c-40d0-ac5d-5baacc722c2f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:12.034518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 386/773] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:11 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:14.055412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c0264-35cc-4b37-a3b9-9666b13627e8 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:14.055954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c0264-35cc-4b37-a3b9-9666b13627e8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:14.055954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c0264-35cc-4b37-a3b9-9666b13627e8 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:14.057637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 388/774] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:14.063542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76623f20-8da8-4b1b-a920-6bcd9481af7d None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:14.063989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76623f20-8da8-4b1b-a920-6bcd9481af7d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:14.064121 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76623f20-8da8-4b1b-a920-6bcd9481af7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:14.086587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-76623f20-8da8-4b1b-a920-6bcd9481af7d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:14.087761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-76623f20-8da8-4b1b-a920-6bcd9481af7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:14.094931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 387/775] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:14 2022] POST /identity/v3/auth/tokens => generated 2438 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:14.116995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c0264-35cc-4b37-a3b9-9666b13627e8 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:14.129272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c0264-35cc-4b37-a3b9-9666b13627e8 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:14.133199 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bd874-4019-4994-80c0-3890348dc78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:14.133765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bd874-4019-4994-80c0-3890348dc78b admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:14.134049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bd874-4019-4994-80c0-3890348dc78b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:14.134335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bd874-4019-4994-80c0-3890348dc78b admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:14.134983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bd874-4019-4994-80c0-3890348dc78b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:14.160742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bd874-4019-4994-80c0-3890348dc78b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:14.238425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 389/776] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:41:14 2022] POST /identity/v3/services => generated 251 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:41:16.369196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173ec6-0f05-498e-844a-b42299804bcd None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:16.369713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173ec6-0f05-498e-844a-b42299804bcd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:16.369713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173ec6-0f05-498e-844a-b42299804bcd None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:16.371365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 388/777] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:16.377708 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667b15-1622-4223-ae2b-55e30bebe867 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:16.378108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667b15-1622-4223-ae2b-55e30bebe867 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:16.378283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d667b15-1622-4223-ae2b-55e30bebe867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:16.401179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-9d667b15-1622-4223-ae2b-55e30bebe867 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:16.402871 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-9d667b15-1622-4223-ae2b-55e30bebe867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:16.422448 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 390/778] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:16 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:16.445430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be173ec6-0f05-498e-844a-b42299804bcd None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:16.459998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be173ec6-0f05-498e-844a-b42299804bcd None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:16.465469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f3541-59a0-4ac1-921f-dc8888d822c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:16.466411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f3541-59a0-4ac1-921f-dc8888d822c8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:16.466784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f3541-59a0-4ac1-921f-dc8888d822c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:16.467157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f3541-59a0-4ac1-921f-dc8888d822c8 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:16.467981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f3541-59a0-4ac1-921f-dc8888d822c8 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:16.503388 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f3541-59a0-4ac1-921f-dc8888d822c8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:16.517434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-8e6f3541-59a0-4ac1-921f-dc8888d822c8 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 18 12:41:16.518867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 389/779] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:16.524894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d667b15-1622-4223-ae2b-55e30bebe867 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:16.534674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d667b15-1622-4223-ae2b-55e30bebe867 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:16.539058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c4982-a133-448e-aea2-489e3b2be401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:16.539681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c4982-a133-448e-aea2-489e3b2be401 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:16.539975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c4982-a133-448e-aea2-489e3b2be401 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:16.540259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c4982-a133-448e-aea2-489e3b2be401 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:16.540930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c4982-a133-448e-aea2-489e3b2be401 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:16.541233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c4982-a133-448e-aea2-489e3b2be401 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:16.568265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c4982-a133-448e-aea2-489e3b2be401 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:16.573272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 391/780] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:16.579188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f3541-59a0-4ac1-921f-dc8888d822c8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:16.588423 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f3541-59a0-4ac1-921f-dc8888d822c8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:16.593252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8163b-35c8-4b9d-b1a1-92b8714289e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:16.593836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8163b-35c8-4b9d-b1a1-92b8714289e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:16.594120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8163b-35c8-4b9d-b1a1-92b8714289e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:16.594402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8163b-35c8-4b9d-b1a1-92b8714289e7 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:16.595069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8163b-35c8-4b9d-b1a1-92b8714289e7 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:16.595400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8163b-35c8-4b9d-b1a1-92b8714289e7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:16.621352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8163b-35c8-4b9d-b1a1-92b8714289e7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:16.626119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 390/781] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:16.631955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c4982-a133-448e-aea2-489e3b2be401 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:16.641722 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c4982-a133-448e-aea2-489e3b2be401 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:16.645956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43568da0-558f-4b05-a817-6dd166229031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:16.646533 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43568da0-558f-4b05-a817-6dd166229031 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:16.646822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43568da0-558f-4b05-a817-6dd166229031 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:16.647108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43568da0-558f-4b05-a817-6dd166229031 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:16.647891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43568da0-558f-4b05-a817-6dd166229031 admin admin] RBAC: Adding query filter params (interface=public, service_id=7168346a601445ffa3781807dd926e4b, region_id=RegionOne) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:16.648201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43568da0-558f-4b05-a817-6dd166229031 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:16.675832 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43568da0-558f-4b05-a817-6dd166229031 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:16.681525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 392/782] 10.222.0.87 () {56 vars in 1272 bytes} [Tue Jan 18 12:41:16 2022] GET /identity/v3/endpoints?service_id=7168346a601445ffa3781807dd926e4b&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:16.688070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8163b-35c8-4b9d-b1a1-92b8714289e7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:16.700268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8163b-35c8-4b9d-b1a1-92b8714289e7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:16.705332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccf9c7-accc-446d-a8d9-eadf15284264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:16.706074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccf9c7-accc-446d-a8d9-eadf15284264 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:16.706424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccf9c7-accc-446d-a8d9-eadf15284264 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:16.706791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccf9c7-accc-446d-a8d9-eadf15284264 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:16.707688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccf9c7-accc-446d-a8d9-eadf15284264 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:16.741044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccf9c7-accc-446d-a8d9-eadf15284264 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:16.747785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 391/783] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:41:16 2022] GET /identity/v3/services => generated 1739 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 12:41:18.904374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0467c66-ce3a-402a-a474-aa14c8072784 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:18.904929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0467c66-ce3a-402a-a474-aa14c8072784 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:18.905084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0467c66-ce3a-402a-a474-aa14c8072784 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:18.906770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 393/784] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:18.912436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd10c-9c50-45c9-aff7-02b1cacd6133 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:18.912863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd10c-9c50-45c9-aff7-02b1cacd6133 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:18.912995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbd10c-9c50-45c9-aff7-02b1cacd6133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:18.935840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1bcbd10c-9c50-45c9-aff7-02b1cacd6133 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:18.936962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1bcbd10c-9c50-45c9-aff7-02b1cacd6133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:18.943694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 392/785] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:18 2022] POST /identity/v3/auth/tokens => generated 2539 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:18.966458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0467c66-ce3a-402a-a474-aa14c8072784 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:18.978230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0467c66-ce3a-402a-a474-aa14c8072784 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:18.982546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78592-60c8-44ee-8b14-a53697c18db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:18.983273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78592-60c8-44ee-8b14-a53697c18db3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:18.983627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78592-60c8-44ee-8b14-a53697c18db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:18.983850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe78592-60c8-44ee-8b14-a53697c18db3 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:18.984460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78592-60c8-44ee-8b14-a53697c18db3 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:19.010238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe78592-60c8-44ee-8b14-a53697c18db3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:19.021420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-dbe78592-60c8-44ee-8b14-a53697c18db3 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 18 12:41:19.022482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 394/786] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:19.029003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd10c-9c50-45c9-aff7-02b1cacd6133 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:19.038556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbd10c-9c50-45c9-aff7-02b1cacd6133 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:19.043332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c121599-ce2f-465e-8d2e-5603ef8b48b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:19.044566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c121599-ce2f-465e-8d2e-5603ef8b48b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:19.045226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c121599-ce2f-465e-8d2e-5603ef8b48b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:19.045739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c121599-ce2f-465e-8d2e-5603ef8b48b9 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:19.046448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c121599-ce2f-465e-8d2e-5603ef8b48b9 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:19.046749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c121599-ce2f-465e-8d2e-5603ef8b48b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:19.090448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c121599-ce2f-465e-8d2e-5603ef8b48b9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:19.095961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 393/787] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:19.101881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78592-60c8-44ee-8b14-a53697c18db3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:19.112542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe78592-60c8-44ee-8b14-a53697c18db3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:19.116756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaca41-072f-4369-89e3-dc1ec4995f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:19.117409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaca41-072f-4369-89e3-dc1ec4995f5c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:19.117770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaca41-072f-4369-89e3-dc1ec4995f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:19.118124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaca41-072f-4369-89e3-dc1ec4995f5c admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:19.118858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaca41-072f-4369-89e3-dc1ec4995f5c admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:19.119226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaca41-072f-4369-89e3-dc1ec4995f5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:19.146304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaca41-072f-4369-89e3-dc1ec4995f5c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:19.151090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 395/788] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:19.157342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c121599-ce2f-465e-8d2e-5603ef8b48b9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:19.167441 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c121599-ce2f-465e-8d2e-5603ef8b48b9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:19.172654 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991af92c-54a0-4b45-bac5-c342ee597b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:19.173276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af92c-54a0-4b45-bac5-c342ee597b80 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:19.173560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af92c-54a0-4b45-bac5-c342ee597b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:19.173839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991af92c-54a0-4b45-bac5-c342ee597b80 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:19.174530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991af92c-54a0-4b45-bac5-c342ee597b80 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:19.201009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991af92c-54a0-4b45-bac5-c342ee597b80 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:19.296761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 394/789] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:41:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:41:21.421338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3c27d-2ab5-4db5-826e-e678860b1727 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:21.421843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3c27d-2ab5-4db5-826e-e678860b1727 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:21.421843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3c27d-2ab5-4db5-826e-e678860b1727 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:21.423507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 396/790] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:21.428645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071e6b-d42f-4cbb-890d-48e0a914513f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:21.429026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071e6b-d42f-4cbb-890d-48e0a914513f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:21.429223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071e6b-d42f-4cbb-890d-48e0a914513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:21.452405 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-7a071e6b-d42f-4cbb-890d-48e0a914513f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:21.453536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7a071e6b-d42f-4cbb-890d-48e0a914513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:21.470552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 395/791] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:21 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:21.493911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3c27d-2ab5-4db5-826e-e678860b1727 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:21.506961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3c27d-2ab5-4db5-826e-e678860b1727 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:21.510989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:21.511633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:21.511928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:21.512818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:21.513490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:21.540439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:21.542085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.common [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 18 12:41:21.595908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.sql.core [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 18 12:41:21.595908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 18 12:41:21.595908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [parameters: {'id': '3e7e5adcecb448fd95641951d5927c87', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 18 12:41:21.595908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66302) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Jan 18 12:41:21.610788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e7e5adcecb448fd95641951d5927c87.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3e7e5adcecb448fd95641951d5927c87. Jan 18 12:41:21.612071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 397/792] 10.222.0.87 () {60 vars in 1161 bytes} [Tue Jan 18 12:41:21 2022] POST /identity/v3/projects => generated 262 bytes in 119 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:21.618298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071e6b-d42f-4cbb-890d-48e0a914513f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:21.628171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071e6b-d42f-4cbb-890d-48e0a914513f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:21.632332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f00c09-0749-45b7-9d8c-f545b92c483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:21.633043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00c09-0749-45b7-9d8c-f545b92c483d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:21.633369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00c09-0749-45b7-9d8c-f545b92c483d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:21.633654 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00c09-0749-45b7-9d8c-f545b92c483d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:21.642194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f00c09-0749-45b7-9d8c-f545b92c483d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:21.670334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f00c09-0749-45b7-9d8c-f545b92c483d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:21.687837 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-51f00c09-0749-45b7-9d8c-f545b92c483d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:41:21.688918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 396/793] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:21.695136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:21.704886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea8582-e2d1-4af2-b1d3-c0e54b484c4e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:21.708964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd1676-ac83-4b07-beb7-97b18c37ef69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:21.709541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd1676-ac83-4b07-beb7-97b18c37ef69 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:21.709833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd1676-ac83-4b07-beb7-97b18c37ef69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:21.710115 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd1676-ac83-4b07-beb7-97b18c37ef69 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:21.710818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd1676-ac83-4b07-beb7-97b18c37ef69 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:21.711117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd1676-ac83-4b07-beb7-97b18c37ef69 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:21.738261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd1676-ac83-4b07-beb7-97b18c37ef69 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:21.755478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 398/794] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:41:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:23.812979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e806a3-4913-4d74-9ad3-25621f7048e6 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:23.813510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e806a3-4913-4d74-9ad3-25621f7048e6 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:23.813624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e806a3-4913-4d74-9ad3-25621f7048e6 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:23.815213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 397/795] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:23.820339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a73ff-c3ed-4972-8f6b-8abb7453c35a None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:23.820715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a73ff-c3ed-4972-8f6b-8abb7453c35a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:23.820912 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a73ff-c3ed-4972-8f6b-8abb7453c35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:23.844511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-3e5a73ff-c3ed-4972-8f6b-8abb7453c35a None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:23.845981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3e5a73ff-c3ed-4972-8f6b-8abb7453c35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:23.852953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 399/796] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:23 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:23.877017 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e806a3-4913-4d74-9ad3-25621f7048e6 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:23.889435 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e806a3-4913-4d74-9ad3-25621f7048e6 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:23.893310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:23.893895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:23.894181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:23.894461 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:23.895101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:23.921882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:23.923214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.common [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 18 12:41:24.004644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.sql.core [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 18 12:41:24.004644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 18 12:41:24.004644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [parameters: {'user_id': '110d631a332940a3868b1009eacadb80', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 18 12:41:24.004644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66304) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Jan 18 12:41:24.018620 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 18 12:41:24.019886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 398/797] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 12:41:23 2022] POST /identity/v3/users => generated 160 bytes in 143 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:24.025810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a73ff-c3ed-4972-8f6b-8abb7453c35a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:24.034479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a73ff-c3ed-4972-8f6b-8abb7453c35a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:24.039431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719c655-0bdb-47c0-a5e4-42c5e9301585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:24.040100 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719c655-0bdb-47c0-a5e4-42c5e9301585 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:24.040383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719c655-0bdb-47c0-a5e4-42c5e9301585 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:24.040659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719c655-0bdb-47c0-a5e4-42c5e9301585 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:24.053524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719c655-0bdb-47c0-a5e4-42c5e9301585 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:24.085304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719c655-0bdb-47c0-a5e4-42c5e9301585 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:24.103965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-5719c655-0bdb-47c0-a5e4-42c5e9301585 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 18 12:41:24.105101 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 400/798] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:41:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:24.111316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:24.124578 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83876c-e156-43e3-9600-b645a7206038 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:24.128625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977930ec-d847-438c-9c7f-8319cc2e7810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:24.129214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977930ec-d847-438c-9c7f-8319cc2e7810 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:24.129494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977930ec-d847-438c-9c7f-8319cc2e7810 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:24.129770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977930ec-d847-438c-9c7f-8319cc2e7810 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:24.130522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977930ec-d847-438c-9c7f-8319cc2e7810 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:24.130847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977930ec-d847-438c-9c7f-8319cc2e7810 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:24.158616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977930ec-d847-438c-9c7f-8319cc2e7810 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:24.193443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 399/799] 10.222.0.87 () {56 vars in 1122 bytes} [Tue Jan 18 12:41:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:26.253960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c565b-0f73-4d42-a431-e6b8700cccc3 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:26.254469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c565b-0f73-4d42-a431-e6b8700cccc3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:26.254552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c565b-0f73-4d42-a431-e6b8700cccc3 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:26.256293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 401/800] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:26.261880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2edb3-ff1b-4aca-95cf-cce965948107 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:26.262358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2edb3-ff1b-4aca-95cf-cce965948107 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:26.262584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2edb3-ff1b-4aca-95cf-cce965948107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:26.285086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-79c2edb3-ff1b-4aca-95cf-cce965948107 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:26.286800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-79c2edb3-ff1b-4aca-95cf-cce965948107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:26.294397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 400/801] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:26 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:26.317630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c565b-0f73-4d42-a431-e6b8700cccc3 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:26.329127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c565b-0f73-4d42-a431-e6b8700cccc3 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:26.333171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d16d5-cc8a-459f-873a-f511e7988bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:26.333884 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d16d5-cc8a-459f-873a-f511e7988bcc admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:26.334170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d16d5-cc8a-459f-873a-f511e7988bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:26.334450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d16d5-cc8a-459f-873a-f511e7988bcc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:26.347198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d16d5-cc8a-459f-873a-f511e7988bcc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:26.373337 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d16d5-cc8a-459f-873a-f511e7988bcc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:26.390014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-846d16d5-cc8a-459f-873a-f511e7988bcc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:26.391097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 402/802] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:26.396947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2edb3-ff1b-4aca-95cf-cce965948107 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:26.406027 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2edb3-ff1b-4aca-95cf-cce965948107 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:26.410102 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48573c90-a3c6-4c30-b423-11e2ab455dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:26.410690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48573c90-a3c6-4c30-b423-11e2ab455dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:26.410979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48573c90-a3c6-4c30-b423-11e2ab455dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:26.411263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48573c90-a3c6-4c30-b423-11e2ab455dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:26.412242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48573c90-a3c6-4c30-b423-11e2ab455dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:26.412543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48573c90-a3c6-4c30-b423-11e2ab455dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:26.439509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48573c90-a3c6-4c30-b423-11e2ab455dd9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:26.453329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 401/803] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:41:26.458962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d16d5-cc8a-459f-873a-f511e7988bcc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:26.469316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d16d5-cc8a-459f-873a-f511e7988bcc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:26.473457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7981128-9286-483d-8b3a-d16c14086a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:26.474098 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981128-9286-483d-8b3a-d16c14086a07 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:26.474385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981128-9286-483d-8b3a-d16c14086a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:26.474664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7981128-9286-483d-8b3a-d16c14086a07 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:26.475325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7981128-9286-483d-8b3a-d16c14086a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:26.501586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7981128-9286-483d-8b3a-d16c14086a07 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:26.660818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 403/804] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:41:26 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:41:28.706409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703189eb-c6b4-44ae-b0bb-e2f0c1942e87 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:28.706933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703189eb-c6b4-44ae-b0bb-e2f0c1942e87 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:28.707021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703189eb-c6b4-44ae-b0bb-e2f0c1942e87 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:28.708700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 402/805] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:28.714111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38f2ce-37c0-499a-89b4-12731e2e948b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:28.714528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38f2ce-37c0-499a-89b4-12731e2e948b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:28.714669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38f2ce-37c0-499a-89b4-12731e2e948b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:28.738522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-2e38f2ce-37c0-499a-89b4-12731e2e948b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:28.739696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2e38f2ce-37c0-499a-89b4-12731e2e948b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:28.746420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 404/806] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:28 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:28.770283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703189eb-c6b4-44ae-b0bb-e2f0c1942e87 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:28.783775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703189eb-c6b4-44ae-b0bb-e2f0c1942e87 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:28.789228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7de98-56a9-4089-9966-6d344d153fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:28.789950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7de98-56a9-4089-9966-6d344d153fea admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:28.790242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7de98-56a9-4089-9966-6d344d153fea admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:28.790525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7de98-56a9-4089-9966-6d344d153fea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:28.801944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f7de98-56a9-4089-9966-6d344d153fea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:41:28.808264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-d9f7de98-56a9-4089-9966-6d344d153fea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:41:28.809896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 403/807] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:41:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:28.815914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38f2ce-37c0-499a-89b4-12731e2e948b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:28.824445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38f2ce-37c0-499a-89b4-12731e2e948b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:28.829218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f54fac-70d9-450e-a779-c140f2c52234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:28.829807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f54fac-70d9-450e-a779-c140f2c52234 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:28.830095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f54fac-70d9-450e-a779-c140f2c52234 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:28.830372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f54fac-70d9-450e-a779-c140f2c52234 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:28.831071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f54fac-70d9-450e-a779-c140f2c52234 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:28.831405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f54fac-70d9-450e-a779-c140f2c52234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:28.857796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f54fac-70d9-450e-a779-c140f2c52234 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:28.866702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 405/808] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:41:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:28.872666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7de98-56a9-4089-9966-6d344d153fea admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:28.883341 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f7de98-56a9-4089-9966-6d344d153fea admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:28.887567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6961651-4f51-45f8-8cd0-93e81d9bf4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:28.888222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6961651-4f51-45f8-8cd0-93e81d9bf4ea admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:28.888512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6961651-4f51-45f8-8cd0-93e81d9bf4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:28.888791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6961651-4f51-45f8-8cd0-93e81d9bf4ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:28.899949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6961651-4f51-45f8-8cd0-93e81d9bf4ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:28.926231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6961651-4f51-45f8-8cd0-93e81d9bf4ea admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:28.944516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-f6961651-4f51-45f8-8cd0-93e81d9bf4ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:28.945655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 404/809] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:28.952011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f54fac-70d9-450e-a779-c140f2c52234 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:28.961507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f54fac-70d9-450e-a779-c140f2c52234 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:28.965516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911efb8-857a-492d-b4a7-a70fcab16d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:28.966140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911efb8-857a-492d-b4a7-a70fcab16d9b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:28.966371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911efb8-857a-492d-b4a7-a70fcab16d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:28.966651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911efb8-857a-492d-b4a7-a70fcab16d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:28.967362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911efb8-857a-492d-b4a7-a70fcab16d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:28.967665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911efb8-857a-492d-b4a7-a70fcab16d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:28.993590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911efb8-857a-492d-b4a7-a70fcab16d9b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:29.006888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 406/810] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:29.012909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6961651-4f51-45f8-8cd0-93e81d9bf4ea admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:29.022149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6961651-4f51-45f8-8cd0-93e81d9bf4ea admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:29.026186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb7241-5cf5-429b-8e4e-0b27caa87846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:29.026901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb7241-5cf5-429b-8e4e-0b27caa87846 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:29.027188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb7241-5cf5-429b-8e4e-0b27caa87846 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:29.027515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb7241-5cf5-429b-8e4e-0b27caa87846 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:29.040270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb7241-5cf5-429b-8e4e-0b27caa87846 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:29.067736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb7241-5cf5-429b-8e4e-0b27caa87846 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:29.086256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-7cfb7241-5cf5-429b-8e4e-0b27caa87846 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 18 12:41:29.087496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 405/811] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:41:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:41:29.093481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911efb8-857a-492d-b4a7-a70fcab16d9b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:29.102867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911efb8-857a-492d-b4a7-a70fcab16d9b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:29.107858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5edb7a-05f4-4369-9227-d1f874474972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:29.108454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5edb7a-05f4-4369-9227-d1f874474972 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:29.108741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5edb7a-05f4-4369-9227-d1f874474972 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:29.109024 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5edb7a-05f4-4369-9227-d1f874474972 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:29.109795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5edb7a-05f4-4369-9227-d1f874474972 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:29.110097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5edb7a-05f4-4369-9227-d1f874474972 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:29.136216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5edb7a-05f4-4369-9227-d1f874474972 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:29.165665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 407/812] 10.222.0.87 () {56 vars in 1160 bytes} [Tue Jan 18 12:41:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:29.172155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb7241-5cf5-429b-8e4e-0b27caa87846 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:29.181285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb7241-5cf5-429b-8e4e-0b27caa87846 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:29.186033 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59beb3-4a9d-4873-9dd2-7ccdc910e48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:29.186600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59beb3-4a9d-4873-9dd2-7ccdc910e48b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:29.186881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59beb3-4a9d-4873-9dd2-7ccdc910e48b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:29.187158 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59beb3-4a9d-4873-9dd2-7ccdc910e48b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:29.194988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59beb3-4a9d-4873-9dd2-7ccdc910e48b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:29.220965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59beb3-4a9d-4873-9dd2-7ccdc910e48b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:29.230579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 406/813] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:41:29 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:41:29.237347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5edb7a-05f4-4369-9227-d1f874474972 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:29.246725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5edb7a-05f4-4369-9227-d1f874474972 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:29.251169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41502c8e-85cb-47d5-97b0-c65e11f27e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:29.251936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41502c8e-85cb-47d5-97b0-c65e11f27e6b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:29.252233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41502c8e-85cb-47d5-97b0-c65e11f27e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:29.252547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41502c8e-85cb-47d5-97b0-c65e11f27e6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:29.264915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41502c8e-85cb-47d5-97b0-c65e11f27e6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:29.291530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41502c8e-85cb-47d5-97b0-c65e11f27e6b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:29.309286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-41502c8e-85cb-47d5-97b0-c65e11f27e6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:29.310867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 408/814] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:29.316528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59beb3-4a9d-4873-9dd2-7ccdc910e48b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:29.325067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59beb3-4a9d-4873-9dd2-7ccdc910e48b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:29.329208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788eee6-aa3b-4908-babb-28f288ea6477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:29.329786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788eee6-aa3b-4908-babb-28f288ea6477 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:29.330075 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788eee6-aa3b-4908-babb-28f288ea6477 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:29.330362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788eee6-aa3b-4908-babb-28f288ea6477 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:29.331046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788eee6-aa3b-4908-babb-28f288ea6477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:29.331378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788eee6-aa3b-4908-babb-28f288ea6477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:29.358217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788eee6-aa3b-4908-babb-28f288ea6477 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:29.371372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 407/815] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:29.377117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41502c8e-85cb-47d5-97b0-c65e11f27e6b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:29.386548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41502c8e-85cb-47d5-97b0-c65e11f27e6b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:29.390704 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed44065-4fc2-4f02-af66-8b57544fcf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:29.391450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed44065-4fc2-4f02-af66-8b57544fcf8b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:29.391741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed44065-4fc2-4f02-af66-8b57544fcf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:29.392021 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed44065-4fc2-4f02-af66-8b57544fcf8b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:29.400745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed44065-4fc2-4f02-af66-8b57544fcf8b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:29.428452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed44065-4fc2-4f02-af66-8b57544fcf8b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:29.442219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-bed44065-4fc2-4f02-af66-8b57544fcf8b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:41:29.443287 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 409/816] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:29.449136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788eee6-aa3b-4908-babb-28f288ea6477 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:29.458652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788eee6-aa3b-4908-babb-28f288ea6477 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:29.462699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601831f-6679-4b1c-8f37-d401d6e00b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:29.463282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601831f-6679-4b1c-8f37-d401d6e00b15 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:29.463600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601831f-6679-4b1c-8f37-d401d6e00b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:29.463888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601831f-6679-4b1c-8f37-d401d6e00b15 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:29.464635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601831f-6679-4b1c-8f37-d401d6e00b15 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:29.464937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601831f-6679-4b1c-8f37-d401d6e00b15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:29.491852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601831f-6679-4b1c-8f37-d401d6e00b15 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:29.505533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 408/817] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:41:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:29.511567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed44065-4fc2-4f02-af66-8b57544fcf8b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:29.520842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed44065-4fc2-4f02-af66-8b57544fcf8b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:29.524830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fe2c1-e968-44ba-adb3-1c83cb5214b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:29.525396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe2c1-e968-44ba-adb3-1c83cb5214b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:29.525685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe2c1-e968-44ba-adb3-1c83cb5214b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:29.525959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fe2c1-e968-44ba-adb3-1c83cb5214b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:29.526722 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fe2c1-e968-44ba-adb3-1c83cb5214b8 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=cb93a689fc8b4aaab37c8fa4f9a08d64) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:29.527022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fe2c1-e968-44ba-adb3-1c83cb5214b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:29.553965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fe2c1-e968-44ba-adb3-1c83cb5214b8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:29.559414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 410/818] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:41:29 2022] GET /identity/v3/role_assignments?user.id=cb93a689fc8b4aaab37c8fa4f9a08d64&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:31.600373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47cf0-1029-4d3a-82cf-ea28f094afdc None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:31.600923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47cf0-1029-4d3a-82cf-ea28f094afdc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:31.600923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa47cf0-1029-4d3a-82cf-ea28f094afdc None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:31.602676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 409/819] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:31.609112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcc6f0-8299-4b29-bfe7-88e426628b86 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:31.609543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcc6f0-8299-4b29-bfe7-88e426628b86 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:31.611168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bcc6f0-8299-4b29-bfe7-88e426628b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:31.632968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-79bcc6f0-8299-4b29-bfe7-88e426628b86 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:31.634094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-79bcc6f0-8299-4b29-bfe7-88e426628b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:31.641470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 411/820] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:31 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:31.663870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa47cf0-1029-4d3a-82cf-ea28f094afdc None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:31.677841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa47cf0-1029-4d3a-82cf-ea28f094afdc None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:31.681670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777aa6-d2c7-453b-8c0e-6077942e4c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:31.682371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777aa6-d2c7-453b-8c0e-6077942e4c53 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:31.682653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777aa6-d2c7-453b-8c0e-6077942e4c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:31.682926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777aa6-d2c7-453b-8c0e-6077942e4c53 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:31.693939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57777aa6-d2c7-453b-8c0e-6077942e4c53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:41:31.700457 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-57777aa6-d2c7-453b-8c0e-6077942e4c53 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:41:31.701514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 410/821] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:41:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:31.707476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcc6f0-8299-4b29-bfe7-88e426628b86 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:31.716846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bcc6f0-8299-4b29-bfe7-88e426628b86 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:31.720952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab91163-37da-4ca2-836f-c99e860e7446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:31.721543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91163-37da-4ca2-836f-c99e860e7446 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:31.721833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91163-37da-4ca2-836f-c99e860e7446 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:31.722117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab91163-37da-4ca2-836f-c99e860e7446 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:31.722820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab91163-37da-4ca2-836f-c99e860e7446 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:31.723125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab91163-37da-4ca2-836f-c99e860e7446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:31.749392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab91163-37da-4ca2-836f-c99e860e7446 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:31.760564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 412/822] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:41:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:31.766259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777aa6-d2c7-453b-8c0e-6077942e4c53 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:31.776066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777aa6-d2c7-453b-8c0e-6077942e4c53 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:31.780682 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67e294-d6ec-4594-acf4-d860a04c8557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:31.781383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67e294-d6ec-4594-acf4-d860a04c8557 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:31.781673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67e294-d6ec-4594-acf4-d860a04c8557 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:31.781957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67e294-d6ec-4594-acf4-d860a04c8557 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:31.793260 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67e294-d6ec-4594-acf4-d860a04c8557 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:31.819487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67e294-d6ec-4594-acf4-d860a04c8557 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:31.838046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-1a67e294-d6ec-4594-acf4-d860a04c8557 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:31.839143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 411/823] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:31.845645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab91163-37da-4ca2-836f-c99e860e7446 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:31.854942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab91163-37da-4ca2-836f-c99e860e7446 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:31.859366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368270f-7c17-42a2-ae16-4e44070f0ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:31.860115 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368270f-7c17-42a2-ae16-4e44070f0ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:31.860410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368270f-7c17-42a2-ae16-4e44070f0ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:31.860691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368270f-7c17-42a2-ae16-4e44070f0ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:31.861470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368270f-7c17-42a2-ae16-4e44070f0ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:31.861688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368270f-7c17-42a2-ae16-4e44070f0ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:31.886994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368270f-7c17-42a2-ae16-4e44070f0ce0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:31.900651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 413/824] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:31.907008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67e294-d6ec-4594-acf4-d860a04c8557 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:31.916892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67e294-d6ec-4594-acf4-d860a04c8557 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:31.921345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55501bf5-d61c-4124-89d4-2c0c08494025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:31.922072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55501bf5-d61c-4124-89d4-2c0c08494025 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:31.922359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55501bf5-d61c-4124-89d4-2c0c08494025 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:31.922641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55501bf5-d61c-4124-89d4-2c0c08494025 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:31.937023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55501bf5-d61c-4124-89d4-2c0c08494025 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:31.962989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55501bf5-d61c-4124-89d4-2c0c08494025 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:31.982235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-55501bf5-d61c-4124-89d4-2c0c08494025 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 18 12:41:31.983360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 412/825] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:41:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:31.989293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368270f-7c17-42a2-ae16-4e44070f0ce0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:31.998775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368270f-7c17-42a2-ae16-4e44070f0ce0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:32.002816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4be9f-556c-46d4-b90a-a6917e697703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:32.003549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4be9f-556c-46d4-b90a-a6917e697703 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:32.003898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4be9f-556c-46d4-b90a-a6917e697703 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:32.004181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4be9f-556c-46d4-b90a-a6917e697703 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:32.004958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4be9f-556c-46d4-b90a-a6917e697703 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:32.005260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4be9f-556c-46d4-b90a-a6917e697703 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:32.031806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4be9f-556c-46d4-b90a-a6917e697703 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:32.060987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 414/826] 10.222.0.87 () {56 vars in 1160 bytes} [Tue Jan 18 12:41:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:32.066527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55501bf5-d61c-4124-89d4-2c0c08494025 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:32.076753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55501bf5-d61c-4124-89d4-2c0c08494025 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:32.080999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b631b7-0e81-4351-b56d-cd265c3954ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:32.081714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b631b7-0e81-4351-b56d-cd265c3954ee admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:32.082004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b631b7-0e81-4351-b56d-cd265c3954ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:32.082289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b631b7-0e81-4351-b56d-cd265c3954ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:32.095157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b631b7-0e81-4351-b56d-cd265c3954ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:32.121097 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b631b7-0e81-4351-b56d-cd265c3954ee admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:32.138885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-d5b631b7-0e81-4351-b56d-cd265c3954ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:32.140064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 413/827] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:32.145734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4be9f-556c-46d4-b90a-a6917e697703 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:32.155376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4be9f-556c-46d4-b90a-a6917e697703 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:32.159515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88c9c-320d-4d44-be97-ad9c70ce65bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:32.160099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88c9c-320d-4d44-be97-ad9c70ce65bb admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:32.160388 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88c9c-320d-4d44-be97-ad9c70ce65bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:32.160672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88c9c-320d-4d44-be97-ad9c70ce65bb admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:32.161356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c88c9c-320d-4d44-be97-ad9c70ce65bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:32.161706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c88c9c-320d-4d44-be97-ad9c70ce65bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:32.189530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c88c9c-320d-4d44-be97-ad9c70ce65bb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:32.203960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 415/828] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:32.209569 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b631b7-0e81-4351-b56d-cd265c3954ee admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:32.220150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b631b7-0e81-4351-b56d-cd265c3954ee admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:32.224287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde512b-3f6b-4f32-abfd-f868afd66f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:32.224998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde512b-3f6b-4f32-abfd-f868afd66f70 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:32.225287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde512b-3f6b-4f32-abfd-f868afd66f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:32.225573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde512b-3f6b-4f32-abfd-f868afd66f70 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:32.234727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde512b-3f6b-4f32-abfd-f868afd66f70 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:32.260803 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde512b-3f6b-4f32-abfd-f868afd66f70 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:32.275321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-afde512b-3f6b-4f32-abfd-f868afd66f70 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:41:32.276451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 414/829] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:41:32.282308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88c9c-320d-4d44-be97-ad9c70ce65bb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:32.291945 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88c9c-320d-4d44-be97-ad9c70ce65bb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:32.296312 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85319e-0a89-41c0-b35e-5a436eff4cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:32.296900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85319e-0a89-41c0-b35e-5a436eff4cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:32.297190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85319e-0a89-41c0-b35e-5a436eff4cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:32.297476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85319e-0a89-41c0-b35e-5a436eff4cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:32.298216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85319e-0a89-41c0-b35e-5a436eff4cb2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:32.298552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85319e-0a89-41c0-b35e-5a436eff4cb2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:32.324405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85319e-0a89-41c0-b35e-5a436eff4cb2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:32.337929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 416/830] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:41:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:32.344292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde512b-3f6b-4f32-abfd-f868afd66f70 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:32.353629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde512b-3f6b-4f32-abfd-f868afd66f70 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:32.357802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a2830-c5d3-49d6-b80f-b95f1b316f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:32.358605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2830-c5d3-49d6-b80f-b95f1b316f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:32.358894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2830-c5d3-49d6-b80f-b95f1b316f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:32.359177 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a2830-c5d3-49d6-b80f-b95f1b316f0d admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/cb93a689fc8b4aaab37c8fa4f9a08d64/roles/021156a7816c4a96874e0a699028ceef` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:32.380051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a2830-c5d3-49d6-b80f-b95f1b316f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=cb93a689fc8b4aaab37c8fa4f9a08d64, role_id=021156a7816c4a96874e0a699028ceef)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:32.406892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a2830-c5d3-49d6-b80f-b95f1b316f0d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:32.500056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 415/831] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:41:32 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/cb93a689fc8b4aaab37c8fa4f9a08d64/roles/021156a7816c4a96874e0a699028ceef => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 12:41:34.458702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a89e8-4e8c-4627-91b2-f564ae5dfb98 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:34.459198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a89e8-4e8c-4627-91b2-f564ae5dfb98 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:34.459198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a89e8-4e8c-4627-91b2-f564ae5dfb98 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:34.460876 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 417/832] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:34.466420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6bd1-c566-4755-8365-10af8fdd82b2 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:34.466859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6bd1-c566-4755-8365-10af8fdd82b2 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:34.466984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6bd1-c566-4755-8365-10af8fdd82b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:34.489511 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-55cf6bd1-c566-4755-8365-10af8fdd82b2 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:34.490655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-55cf6bd1-c566-4755-8365-10af8fdd82b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:34.555280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 416/833] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:34 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:41:34.577612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a89e8-4e8c-4627-91b2-f564ae5dfb98 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:34.589258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a89e8-4e8c-4627-91b2-f564ae5dfb98 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:34.593744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820fb98-af4c-40b8-abe6-4fc24ba69b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:34.594452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820fb98-af4c-40b8-abe6-4fc24ba69b32 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:34.594742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820fb98-af4c-40b8-abe6-4fc24ba69b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:34.595025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820fb98-af4c-40b8-abe6-4fc24ba69b32 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:34.606172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820fb98-af4c-40b8-abe6-4fc24ba69b32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:41:34.613093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-8820fb98-af4c-40b8-abe6-4fc24ba69b32 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:41:34.614169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 418/834] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:41:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:34.619893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6bd1-c566-4755-8365-10af8fdd82b2 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:34.629286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6bd1-c566-4755-8365-10af8fdd82b2 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:34.633591 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da15fe0-47b1-4123-b9c8-085c070de34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:34.634188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15fe0-47b1-4123-b9c8-085c070de34e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:34.634479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15fe0-47b1-4123-b9c8-085c070de34e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:34.634762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da15fe0-47b1-4123-b9c8-085c070de34e admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:34.635521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da15fe0-47b1-4123-b9c8-085c070de34e admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:34.635824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da15fe0-47b1-4123-b9c8-085c070de34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:34.661718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da15fe0-47b1-4123-b9c8-085c070de34e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:34.670913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 417/835] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:41:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:34.676628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820fb98-af4c-40b8-abe6-4fc24ba69b32 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:34.688894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820fb98-af4c-40b8-abe6-4fc24ba69b32 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:34.693025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23307591-41bc-480f-ad74-1cabb73c9e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:34.698074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23307591-41bc-480f-ad74-1cabb73c9e93 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:34.698074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23307591-41bc-480f-ad74-1cabb73c9e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:34.698074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23307591-41bc-480f-ad74-1cabb73c9e93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:34.706092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23307591-41bc-480f-ad74-1cabb73c9e93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:34.731633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23307591-41bc-480f-ad74-1cabb73c9e93 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:34.749969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-23307591-41bc-480f-ad74-1cabb73c9e93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:34.751077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 419/836] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:34.757072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da15fe0-47b1-4123-b9c8-085c070de34e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:34.767082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da15fe0-47b1-4123-b9c8-085c070de34e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:34.771113 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e81aea-79c4-431d-b453-8db4997e075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:34.771726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e81aea-79c4-431d-b453-8db4997e075c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:34.772010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e81aea-79c4-431d-b453-8db4997e075c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:34.772289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e81aea-79c4-431d-b453-8db4997e075c admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:34.773010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e81aea-79c4-431d-b453-8db4997e075c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:34.773304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e81aea-79c4-431d-b453-8db4997e075c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:34.800928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e81aea-79c4-431d-b453-8db4997e075c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:34.816820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 418/837] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:34.822415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23307591-41bc-480f-ad74-1cabb73c9e93 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:34.832443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23307591-41bc-480f-ad74-1cabb73c9e93 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:34.836591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe43b00-fd19-4d6c-8dbd-946d49766f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:34.837300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe43b00-fd19-4d6c-8dbd-946d49766f38 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:34.837588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe43b00-fd19-4d6c-8dbd-946d49766f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:34.837888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe43b00-fd19-4d6c-8dbd-946d49766f38 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:34.850697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe43b00-fd19-4d6c-8dbd-946d49766f38 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:34.877909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe43b00-fd19-4d6c-8dbd-946d49766f38 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:34.895859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-5fe43b00-fd19-4d6c-8dbd-946d49766f38 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 18 12:41:34.896948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 420/838] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:41:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:34.902768 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e81aea-79c4-431d-b453-8db4997e075c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:34.912844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e81aea-79c4-431d-b453-8db4997e075c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:34.916923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639584b-0989-4bcf-87f9-64e0fbfad217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:34.917513 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639584b-0989-4bcf-87f9-64e0fbfad217 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:34.917799 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639584b-0989-4bcf-87f9-64e0fbfad217 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:34.918080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639584b-0989-4bcf-87f9-64e0fbfad217 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:34.918868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639584b-0989-4bcf-87f9-64e0fbfad217 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:34.919836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639584b-0989-4bcf-87f9-64e0fbfad217 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:34.946351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639584b-0989-4bcf-87f9-64e0fbfad217 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:34.975793 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 419/839] 10.222.0.87 () {56 vars in 1160 bytes} [Tue Jan 18 12:41:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:34.982051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe43b00-fd19-4d6c-8dbd-946d49766f38 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:34.991476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe43b00-fd19-4d6c-8dbd-946d49766f38 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:34.995531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f0cc1-62a8-4dc8-821d-59d425afa8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:34.996098 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f0cc1-62a8-4dc8-821d-59d425afa8cb admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:34.996387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f0cc1-62a8-4dc8-821d-59d425afa8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:34.996670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022f0cc1-62a8-4dc8-821d-59d425afa8cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:35.005170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f0cc1-62a8-4dc8-821d-59d425afa8cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:35.031095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022f0cc1-62a8-4dc8-821d-59d425afa8cb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:35.040616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 421/840] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:41:34 2022] GET /identity/v3/auth/tokens => generated 2725 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:41:35.046968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639584b-0989-4bcf-87f9-64e0fbfad217 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:35.056513 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639584b-0989-4bcf-87f9-64e0fbfad217 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:35.061166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53935a15-78b5-44f4-a8d6-c80336536b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:35.061877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53935a15-78b5-44f4-a8d6-c80336536b97 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:35.062160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53935a15-78b5-44f4-a8d6-c80336536b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:35.062433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53935a15-78b5-44f4-a8d6-c80336536b97 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:35.074071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53935a15-78b5-44f4-a8d6-c80336536b97 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:35.100469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53935a15-78b5-44f4-a8d6-c80336536b97 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:35.122869 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-53935a15-78b5-44f4-a8d6-c80336536b97 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:35.124020 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 420/841] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:35.129706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f0cc1-62a8-4dc8-821d-59d425afa8cb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:35.138420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022f0cc1-62a8-4dc8-821d-59d425afa8cb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:35.142542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4de1fd-ad1c-4fb5-b3e9-ae634a8a78a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:35.143116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4de1fd-ad1c-4fb5-b3e9-ae634a8a78a9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:35.143438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4de1fd-ad1c-4fb5-b3e9-ae634a8a78a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:35.143721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4de1fd-ad1c-4fb5-b3e9-ae634a8a78a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:35.144394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4de1fd-ad1c-4fb5-b3e9-ae634a8a78a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:35.144690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4de1fd-ad1c-4fb5-b3e9-ae634a8a78a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:35.171281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4de1fd-ad1c-4fb5-b3e9-ae634a8a78a9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:35.184014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 422/842] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:35.190305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53935a15-78b5-44f4-a8d6-c80336536b97 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:35.199705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53935a15-78b5-44f4-a8d6-c80336536b97 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:35.203942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2581568-a1c9-43bc-8f65-7ef5e44d4828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:35.204653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2581568-a1c9-43bc-8f65-7ef5e44d4828 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:35.204942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2581568-a1c9-43bc-8f65-7ef5e44d4828 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:35.205243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2581568-a1c9-43bc-8f65-7ef5e44d4828 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:35.214253 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2581568-a1c9-43bc-8f65-7ef5e44d4828 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:35.240981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2581568-a1c9-43bc-8f65-7ef5e44d4828 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:35.254655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-e2581568-a1c9-43bc-8f65-7ef5e44d4828 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:41:35.255781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 421/843] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:35.262036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4de1fd-ad1c-4fb5-b3e9-ae634a8a78a9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:35.271548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4de1fd-ad1c-4fb5-b3e9-ae634a8a78a9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:35.275570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163ef81-88ec-4363-a7ef-397e31e02ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:35.276142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163ef81-88ec-4363-a7ef-397e31e02ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:35.276427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163ef81-88ec-4363-a7ef-397e31e02ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:35.276706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163ef81-88ec-4363-a7ef-397e31e02ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:35.277432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163ef81-88ec-4363-a7ef-397e31e02ff8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:35.277731 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163ef81-88ec-4363-a7ef-397e31e02ff8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:35.304552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163ef81-88ec-4363-a7ef-397e31e02ff8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:35.321692 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 423/844] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:41:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:35.327984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2581568-a1c9-43bc-8f65-7ef5e44d4828 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:35.337504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2581568-a1c9-43bc-8f65-7ef5e44d4828 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:35.342507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce8c3c-a8fe-4745-a5b9-e7056168b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:35.343074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce8c3c-a8fe-4745-a5b9-e7056168b53c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:35.343395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce8c3c-a8fe-4745-a5b9-e7056168b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:35.343678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce8c3c-a8fe-4745-a5b9-e7056168b53c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:35.344500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce8c3c-a8fe-4745-a5b9-e7056168b53c admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=cb93a689fc8b4aaab37c8fa4f9a08d64) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:35.344804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce8c3c-a8fe-4745-a5b9-e7056168b53c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:35.371285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce8c3c-a8fe-4745-a5b9-e7056168b53c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:35.377458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 422/845] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:41:35 2022] GET /identity/v3/role_assignments?user.id=cb93a689fc8b4aaab37c8fa4f9a08d64&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:37.461911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd598a5-4c58-411c-8327-50fce1efe578 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:37.462451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd598a5-4c58-411c-8327-50fce1efe578 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:37.462451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd598a5-4c58-411c-8327-50fce1efe578 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:37.464134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 424/846] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:37.470533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4d586-ffa1-4d65-bdcb-5ab29d7fb9a8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:37.470979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4d586-ffa1-4d65-bdcb-5ab29d7fb9a8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:37.471098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4d586-ffa1-4d65-bdcb-5ab29d7fb9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:37.496251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-37f4d586-ffa1-4d65-bdcb-5ab29d7fb9a8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:37.497982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-37f4d586-ffa1-4d65-bdcb-5ab29d7fb9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:37.504822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 423/847] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:37 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:37.527491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd598a5-4c58-411c-8327-50fce1efe578 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:37.540095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd598a5-4c58-411c-8327-50fce1efe578 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:37.544911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc56d0-680b-4ef8-b998-4a265924fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:37.545671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc56d0-680b-4ef8-b998-4a265924fc27 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:37.545960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc56d0-680b-4ef8-b998-4a265924fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:37.546240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc56d0-680b-4ef8-b998-4a265924fc27 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:37.546858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc56d0-680b-4ef8-b998-4a265924fc27 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:37.572256 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc56d0-680b-4ef8-b998-4a265924fc27 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:37.582882 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-1fcc56d0-680b-4ef8-b998-4a265924fc27 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 18 12:41:37.583976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 425/848] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:37 2022] GET /identity/v3/services/network => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:37.589883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4d586-ffa1-4d65-bdcb-5ab29d7fb9a8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:37.598971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4d586-ffa1-4d65-bdcb-5ab29d7fb9a8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:37.603061 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f4d2a-ddde-4f40-8d32-f48b80e810b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:37.603694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4d2a-ddde-4f40-8d32-f48b80e810b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:37.603984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4d2a-ddde-4f40-8d32-f48b80e810b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:37.604267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f4d2a-ddde-4f40-8d32-f48b80e810b3 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:37.604942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f4d2a-ddde-4f40-8d32-f48b80e810b3 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:37.605243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f4d2a-ddde-4f40-8d32-f48b80e810b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:37.631790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f4d2a-ddde-4f40-8d32-f48b80e810b3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:37.637026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 424/849] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:41:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:37.643253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc56d0-680b-4ef8-b998-4a265924fc27 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:37.652498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc56d0-680b-4ef8-b998-4a265924fc27 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:37.657078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7313cd-0147-4b12-9fa8-9a32ec501c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:37.657649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7313cd-0147-4b12-9fa8-9a32ec501c6b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:37.657936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7313cd-0147-4b12-9fa8-9a32ec501c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:37.658216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7313cd-0147-4b12-9fa8-9a32ec501c6b admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:37.658868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7313cd-0147-4b12-9fa8-9a32ec501c6b admin admin] RBAC: Adding query filter params (type=network) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:37.659161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7313cd-0147-4b12-9fa8-9a32ec501c6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:37.685373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7313cd-0147-4b12-9fa8-9a32ec501c6b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:37.689940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 426/850] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:41:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:39.788671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ec85-ef9b-4354-9b55-11c5005a4122 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:39.789222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ec85-ef9b-4354-9b55-11c5005a4122 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:39.789222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650ec85-ef9b-4354-9b55-11c5005a4122 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:39.790889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 425/851] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:39.796614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fcf31-d8a5-4d2a-98e7-33daa1f0d539 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:39.797021 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fcf31-d8a5-4d2a-98e7-33daa1f0d539 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:39.797189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fcf31-d8a5-4d2a-98e7-33daa1f0d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:39.819387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-4f6fcf31-d8a5-4d2a-98e7-33daa1f0d539 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:39.820513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-4f6fcf31-d8a5-4d2a-98e7-33daa1f0d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:39.827334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 427/852] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:39 2022] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:39.849494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ec85-ef9b-4354-9b55-11c5005a4122 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:39.861789 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650ec85-ef9b-4354-9b55-11c5005a4122 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:39.865618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad807de3-d3fb-4239-88f1-9b968cbdd86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:39.866199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807de3-d3fb-4239-88f1-9b968cbdd86c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:39.866484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807de3-d3fb-4239-88f1-9b968cbdd86c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:39.866757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807de3-d3fb-4239-88f1-9b968cbdd86c admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:39.867468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad807de3-d3fb-4239-88f1-9b968cbdd86c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:39.893700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad807de3-d3fb-4239-88f1-9b968cbdd86c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:40.041824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 426/853] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:41:39 2022] POST /identity/v3/services => generated 240 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:41:42.041943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128afb85-b9d7-4d1b-b16d-a707b3aa032a None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:42.042503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128afb85-b9d7-4d1b-b16d-a707b3aa032a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:42.042503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128afb85-b9d7-4d1b-b16d-a707b3aa032a None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:42.044211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 428/854] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:42.050715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca7054-0f8a-4e6d-8f57-d084d67b5fcd None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:42.051224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca7054-0f8a-4e6d-8f57-d084d67b5fcd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:42.051348 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca7054-0f8a-4e6d-8f57-d084d67b5fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:42.074174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ecca7054-0f8a-4e6d-8f57-d084d67b5fcd None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:42.075333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ecca7054-0f8a-4e6d-8f57-d084d67b5fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:42.094578 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 427/855] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:42 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:42.117983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128afb85-b9d7-4d1b-b16d-a707b3aa032a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:42.129773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128afb85-b9d7-4d1b-b16d-a707b3aa032a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:42.133716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f771450-529e-4de6-9fb0-6a566d1a61e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:42.134416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771450-529e-4de6-9fb0-6a566d1a61e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:42.134703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771450-529e-4de6-9fb0-6a566d1a61e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:42.134973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f771450-529e-4de6-9fb0-6a566d1a61e0 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:42.135622 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f771450-529e-4de6-9fb0-6a566d1a61e0 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:42.162052 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f771450-529e-4de6-9fb0-6a566d1a61e0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:42.173710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-6f771450-529e-4de6-9fb0-6a566d1a61e0 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 18 12:41:42.174814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 429/856] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:42 2022] GET /identity/v3/services/network => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:42.180988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca7054-0f8a-4e6d-8f57-d084d67b5fcd None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:42.189933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca7054-0f8a-4e6d-8f57-d084d67b5fcd None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:42.194045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506644d6-cdec-4b04-9140-813b1acebd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:42.194637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506644d6-cdec-4b04-9140-813b1acebd29 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:42.194923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506644d6-cdec-4b04-9140-813b1acebd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:42.195204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506644d6-cdec-4b04-9140-813b1acebd29 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:42.195926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506644d6-cdec-4b04-9140-813b1acebd29 admin admin] RBAC: Adding query filter params (name=network) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:42.196225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506644d6-cdec-4b04-9140-813b1acebd29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:42.222118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506644d6-cdec-4b04-9140-813b1acebd29 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:42.227429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 428/857] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:41:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:42.233889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f771450-529e-4de6-9fb0-6a566d1a61e0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:42.243153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f771450-529e-4de6-9fb0-6a566d1a61e0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:42.247360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491148c-94e1-4fe9-93d8-276033a05752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:42.247947 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491148c-94e1-4fe9-93d8-276033a05752 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:42.248231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491148c-94e1-4fe9-93d8-276033a05752 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:42.248510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491148c-94e1-4fe9-93d8-276033a05752 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:42.249173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491148c-94e1-4fe9-93d8-276033a05752 admin admin] RBAC: Adding query filter params (type=network) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:42.249480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491148c-94e1-4fe9-93d8-276033a05752 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:42.274892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491148c-94e1-4fe9-93d8-276033a05752 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:42.280198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 430/858] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:41:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:42.286030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506644d6-cdec-4b04-9140-813b1acebd29 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:42.296524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506644d6-cdec-4b04-9140-813b1acebd29 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:42.300901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a68848-21f4-4130-bc45-932d83f0b7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:42.301557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a68848-21f4-4130-bc45-932d83f0b7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:42.301888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a68848-21f4-4130-bc45-932d83f0b7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:42.302215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a68848-21f4-4130-bc45-932d83f0b7e2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:42.303056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a68848-21f4-4130-bc45-932d83f0b7e2 admin admin] RBAC: Adding query filter params (interface=public, service_id=a0e74272c36d485e83f906715b2f0607, region_id=RegionOne) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:42.303447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a68848-21f4-4130-bc45-932d83f0b7e2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:42.331996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a68848-21f4-4130-bc45-932d83f0b7e2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:42.345966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 429/859] 10.222.0.87 () {56 vars in 1272 bytes} [Tue Jan 18 12:41:42 2022] GET /identity/v3/endpoints?service_id=a0e74272c36d485e83f906715b2f0607&interface=public®ion_id=RegionOne => generated 194 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:42.352279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491148c-94e1-4fe9-93d8-276033a05752 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:42.361677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491148c-94e1-4fe9-93d8-276033a05752 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:42.365806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc6d3-03c9-4fcc-a082-1146b2631a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:42.366388 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc6d3-03c9-4fcc-a082-1146b2631a8f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:42.366680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc6d3-03c9-4fcc-a082-1146b2631a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:42.366964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc6d3-03c9-4fcc-a082-1146b2631a8f admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:42.367641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc6d3-03c9-4fcc-a082-1146b2631a8f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:42.393931 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc6d3-03c9-4fcc-a082-1146b2631a8f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:42.400804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 431/860] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:41:42 2022] GET /identity/v3/services => generated 1967 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 12:41:44.429660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba91cf-7f9a-4401-bc4a-3aa127bf85b1 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:44.430193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba91cf-7f9a-4401-bc4a-3aa127bf85b1 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:44.430193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba91cf-7f9a-4401-bc4a-3aa127bf85b1 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:44.431852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 430/861] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:44.437983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f90a2e-f556-49e4-aa44-53a1aeb4fb02 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:44.438427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f90a2e-f556-49e4-aa44-53a1aeb4fb02 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:44.438546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f90a2e-f556-49e4-aa44-53a1aeb4fb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:44.461702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-29f90a2e-f556-49e4-aa44-53a1aeb4fb02 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:44.462831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-29f90a2e-f556-49e4-aa44-53a1aeb4fb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:44.469727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 432/862] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:44 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:44.492469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba91cf-7f9a-4401-bc4a-3aa127bf85b1 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:44.505375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba91cf-7f9a-4401-bc4a-3aa127bf85b1 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:44.509384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68dc17-eabc-4029-962e-24fc6a7c7c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:44.510098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68dc17-eabc-4029-962e-24fc6a7c7c42 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:44.510394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68dc17-eabc-4029-962e-24fc6a7c7c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:44.510678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68dc17-eabc-4029-962e-24fc6a7c7c42 admin admin] PATH_INFO: `/v3/services/network` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:44.511323 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68dc17-eabc-4029-962e-24fc6a7c7c42 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:44.538889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68dc17-eabc-4029-962e-24fc6a7c7c42 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:44.550722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-5e68dc17-eabc-4029-962e-24fc6a7c7c42 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 18 12:41:44.551852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 431/863] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:44 2022] GET /identity/v3/services/network => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:44.557903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f90a2e-f556-49e4-aa44-53a1aeb4fb02 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:44.567490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f90a2e-f556-49e4-aa44-53a1aeb4fb02 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:44.571656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6597-e71d-4ee0-a19f-3e4251fa986a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:44.572241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6597-e71d-4ee0-a19f-3e4251fa986a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:44.572528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6597-e71d-4ee0-a19f-3e4251fa986a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:44.572810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e6597-e71d-4ee0-a19f-3e4251fa986a admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:44.573475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e6597-e71d-4ee0-a19f-3e4251fa986a admin admin] RBAC: Adding query filter params (name=network) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:44.573775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e6597-e71d-4ee0-a19f-3e4251fa986a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:44.601483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e6597-e71d-4ee0-a19f-3e4251fa986a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:44.606432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 433/864] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:41:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:44.612615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68dc17-eabc-4029-962e-24fc6a7c7c42 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:44.621709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68dc17-eabc-4029-962e-24fc6a7c7c42 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:44.626520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6cbf6-ecba-4c75-882f-f885e0d720aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:44.627094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6cbf6-ecba-4c75-882f-f885e0d720aa admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:44.627409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6cbf6-ecba-4c75-882f-f885e0d720aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:44.627688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6cbf6-ecba-4c75-882f-f885e0d720aa admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:44.628349 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6cbf6-ecba-4c75-882f-f885e0d720aa admin admin] RBAC: Adding query filter params (type=network) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:44.628642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6cbf6-ecba-4c75-882f-f885e0d720aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:44.655445 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6cbf6-ecba-4c75-882f-f885e0d720aa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:44.660477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 432/865] 10.222.0.87 () {56 vars in 1133 bytes} [Tue Jan 18 12:41:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:44.666390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6597-e71d-4ee0-a19f-3e4251fa986a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:44.676700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e6597-e71d-4ee0-a19f-3e4251fa986a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:44.680940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac2ee1-a52d-457b-9c62-0c517c7c1079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:44.681457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac2ee1-a52d-457b-9c62-0c517c7c1079 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:44.681749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac2ee1-a52d-457b-9c62-0c517c7c1079 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:44.682036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac2ee1-a52d-457b-9c62-0c517c7c1079 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:44.682718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac2ee1-a52d-457b-9c62-0c517c7c1079 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:44.709394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac2ee1-a52d-457b-9c62-0c517c7c1079 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:44.796311 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 434/866] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:41:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:41:46.887113 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cff6a-a103-40d3-b871-15b952260bc3 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:46.887695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cff6a-a103-40d3-b871-15b952260bc3 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:46.887695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cff6a-a103-40d3-b871-15b952260bc3 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:46.889974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 433/867] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:46.895217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9df8-39d2-48e8-b522-c20df5f42075 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:46.895654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9df8-39d2-48e8-b522-c20df5f42075 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:46.895810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e9df8-39d2-48e8-b522-c20df5f42075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:46.918717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-296e9df8-39d2-48e8-b522-c20df5f42075 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:46.919934 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-296e9df8-39d2-48e8-b522-c20df5f42075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:46.937614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 435/868] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:46.960026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cff6a-a103-40d3-b871-15b952260bc3 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:46.972628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cff6a-a103-40d3-b871-15b952260bc3 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:46.976598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:46.977179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:46.977465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:46.977744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:46.978551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:47.003873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:47.035085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.sql.core [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 18 12:41:47.035085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 18 12:41:47.035085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [parameters: {'id': '6768c2fcf33d464c8703a3453ad26575', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 18 12:41:47.035085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=66304) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Jan 18 12:41:47.041152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 18 12:41:47.042270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 434/869] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 12:41:46 2022] POST /identity/v3/roles => generated 144 bytes in 83 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:47.048305 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e9df8-39d2-48e8-b522-c20df5f42075 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:47.057095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e9df8-39d2-48e8-b522-c20df5f42075 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:47.061271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67efdbb-7e0d-480d-b364-353874564e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:47.062076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67efdbb-7e0d-480d-b364-353874564e88 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:47.062425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67efdbb-7e0d-480d-b364-353874564e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:47.062798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67efdbb-7e0d-480d-b364-353874564e88 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:47.074723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67efdbb-7e0d-480d-b364-353874564e88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:41:47.082264 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-f67efdbb-7e0d-480d-b364-353874564e88 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 18 12:41:47.083388 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 436/870] 10.222.0.87 () {56 vars in 1135 bytes} [Tue Jan 18 12:41:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:47.089624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:47.099279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745012b-e768-4079-ac37-93c03bb57e8d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:47.103336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a2927-9d0f-4d2a-898c-3ac95868a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:47.103914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2927-9d0f-4d2a-898c-3ac95868a5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:47.104193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2927-9d0f-4d2a-898c-3ac95868a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:47.104470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a2927-9d0f-4d2a-898c-3ac95868a5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:47.105171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2927-9d0f-4d2a-898c-3ac95868a5a7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:47.105464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2927-9d0f-4d2a-898c-3ac95868a5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:47.131414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a2927-9d0f-4d2a-898c-3ac95868a5a7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:47.143434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 435/871] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:49.151520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ccdc-6679-4f27-bc71-562c876fe450 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:49.152060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ccdc-6679-4f27-bc71-562c876fe450 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:49.152060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5ccdc-6679-4f27-bc71-562c876fe450 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:49.153745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 437/872] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:49.159112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ecdc5-e85b-46ef-9168-9dfabe057f6f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:49.159566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ecdc5-e85b-46ef-9168-9dfabe057f6f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:49.159714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ecdc5-e85b-46ef-9168-9dfabe057f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:49.183044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-254ecdc5-e85b-46ef-9168-9dfabe057f6f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:49.184204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-254ecdc5-e85b-46ef-9168-9dfabe057f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:49.192168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 436/873] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:49.215867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5ccdc-6679-4f27-bc71-562c876fe450 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:49.228088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5ccdc-6679-4f27-bc71-562c876fe450 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:49.232004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7702fa-0b0c-4543-be84-555fee835163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:49.233239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7702fa-0b0c-4543-be84-555fee835163 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:49.233525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7702fa-0b0c-4543-be84-555fee835163 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:49.233809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7702fa-0b0c-4543-be84-555fee835163 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:49.244691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7702fa-0b0c-4543-be84-555fee835163 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:49.270742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7702fa-0b0c-4543-be84-555fee835163 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:49.289511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-9e7702fa-0b0c-4543-be84-555fee835163 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:49.290726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 438/874] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:49.297309 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ecdc5-e85b-46ef-9168-9dfabe057f6f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:49.305916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ecdc5-e85b-46ef-9168-9dfabe057f6f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:49.310127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e885e7-7738-4203-84a8-2e1fa650221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:49.311384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e885e7-7738-4203-84a8-2e1fa650221c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:49.311712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e885e7-7738-4203-84a8-2e1fa650221c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:49.311986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e885e7-7738-4203-84a8-2e1fa650221c admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:49.312664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e885e7-7738-4203-84a8-2e1fa650221c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:49.312958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e885e7-7738-4203-84a8-2e1fa650221c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:49.338206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e885e7-7738-4203-84a8-2e1fa650221c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:49.350923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 437/875] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:49.356694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7702fa-0b0c-4543-be84-555fee835163 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:49.366589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7702fa-0b0c-4543-be84-555fee835163 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:49.370757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cc710-8193-454c-ae4b-9bc9770e20f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:49.371370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc710-8193-454c-ae4b-9bc9770e20f6 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:49.371669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc710-8193-454c-ae4b-9bc9770e20f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:49.371953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc710-8193-454c-ae4b-9bc9770e20f6 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:49.372606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cc710-8193-454c-ae4b-9bc9770e20f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:49.399226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cc710-8193-454c-ae4b-9bc9770e20f6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:49.501647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 439/876] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:41:49 2022] POST /identity/v3/users => generated 247 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:41:51.562608 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38d6f-30d0-44c6-b33e-b92a271caebf None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:51.563143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38d6f-30d0-44c6-b33e-b92a271caebf None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:51.563143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba38d6f-30d0-44c6-b33e-b92a271caebf None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:51.564873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 438/877] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:51.570292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2c15-c5d0-44f6-a544-9801ad61eeaa None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:51.570730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2c15-c5d0-44f6-a544-9801ad61eeaa None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:51.570862 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2c15-c5d0-44f6-a544-9801ad61eeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:51.606075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-982f2c15-c5d0-44f6-a544-9801ad61eeaa None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:51.607238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-982f2c15-c5d0-44f6-a544-9801ad61eeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:51.615220 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 440/878] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:51.649022 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba38d6f-30d0-44c6-b33e-b92a271caebf None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:51.662229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba38d6f-30d0-44c6-b33e-b92a271caebf None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:51.666905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bfeb8-a0c6-45bb-83fc-91a1a5184dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:51.667655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bfeb8-a0c6-45bb-83fc-91a1a5184dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:51.667943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bfeb8-a0c6-45bb-83fc-91a1a5184dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:51.668220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bfeb8-a0c6-45bb-83fc-91a1a5184dd9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:51.680430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bfeb8-a0c6-45bb-83fc-91a1a5184dd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:41:51.688598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-210bfeb8-a0c6-45bb-83fc-91a1a5184dd9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:41:51.689775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 439/879] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:41:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:51.697770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f2c15-c5d0-44f6-a544-9801ad61eeaa None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:51.707432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f2c15-c5d0-44f6-a544-9801ad61eeaa None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:51.711690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cd0aa-7420-45b1-9015-820b12a6262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:51.712288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cd0aa-7420-45b1-9015-820b12a6262c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:51.712572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cd0aa-7420-45b1-9015-820b12a6262c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:51.712854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cd0aa-7420-45b1-9015-820b12a6262c admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:51.713553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cd0aa-7420-45b1-9015-820b12a6262c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:51.713849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cd0aa-7420-45b1-9015-820b12a6262c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:51.745990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7cd0aa-7420-45b1-9015-820b12a6262c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:51.756139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 441/880] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:41:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:51.768922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bfeb8-a0c6-45bb-83fc-91a1a5184dd9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:51.781673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bfeb8-a0c6-45bb-83fc-91a1a5184dd9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:51.786359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fb378-1af1-443a-95a1-76b6f54d4aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:51.787536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fb378-1af1-443a-95a1-76b6f54d4aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:51.788039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fb378-1af1-443a-95a1-76b6f54d4aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:51.788435 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95fb378-1af1-443a-95a1-76b6f54d4aa5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:51.801686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fb378-1af1-443a-95a1-76b6f54d4aa5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:51.829075 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95fb378-1af1-443a-95a1-76b6f54d4aa5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:51.849055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b95fb378-1af1-443a-95a1-76b6f54d4aa5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:51.850373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 440/881] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:51.857282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cd0aa-7420-45b1-9015-820b12a6262c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:51.867915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cd0aa-7420-45b1-9015-820b12a6262c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:51.872490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbab40-e315-4a7c-af5b-a658f99b080b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:51.873146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbab40-e315-4a7c-af5b-a658f99b080b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:51.873579 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbab40-e315-4a7c-af5b-a658f99b080b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:51.874109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbab40-e315-4a7c-af5b-a658f99b080b admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:51.874792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbab40-e315-4a7c-af5b-a658f99b080b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:51.875092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbab40-e315-4a7c-af5b-a658f99b080b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:51.906239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbab40-e315-4a7c-af5b-a658f99b080b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:51.921963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 442/882] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:51.927770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fb378-1af1-443a-95a1-76b6f54d4aa5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:51.942149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95fb378-1af1-443a-95a1-76b6f54d4aa5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:51.946627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba222d1-e919-4751-87b3-f2ded59ec017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:51.947379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba222d1-e919-4751-87b3-f2ded59ec017 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:51.947666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba222d1-e919-4751-87b3-f2ded59ec017 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:51.947944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba222d1-e919-4751-87b3-f2ded59ec017 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:51.965242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba222d1-e919-4751-87b3-f2ded59ec017 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:51.994765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba222d1-e919-4751-87b3-f2ded59ec017 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:52.013069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-6ba222d1-e919-4751-87b3-f2ded59ec017 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 18 12:41:52.014277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 441/883] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:41:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:52.020150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbab40-e315-4a7c-af5b-a658f99b080b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:52.029980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbab40-e315-4a7c-af5b-a658f99b080b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:52.034155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a36f92-ace3-4d29-86e6-708755e3e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:52.034735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a36f92-ace3-4d29-86e6-708755e3e663 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:52.035015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a36f92-ace3-4d29-86e6-708755e3e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:52.035300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a36f92-ace3-4d29-86e6-708755e3e663 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:52.036099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a36f92-ace3-4d29-86e6-708755e3e663 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:52.036395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a36f92-ace3-4d29-86e6-708755e3e663 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:52.062786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a36f92-ace3-4d29-86e6-708755e3e663 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:52.093415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 443/884] 10.222.0.87 () {56 vars in 1156 bytes} [Tue Jan 18 12:41:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:52.099211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba222d1-e919-4751-87b3-f2ded59ec017 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:52.108655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba222d1-e919-4751-87b3-f2ded59ec017 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:52.112716 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce403bc-9c62-4945-8150-f7b1c44f35c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:52.113283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce403bc-9c62-4945-8150-f7b1c44f35c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:52.113568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce403bc-9c62-4945-8150-f7b1c44f35c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:52.113850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce403bc-9c62-4945-8150-f7b1c44f35c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:52.121581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce403bc-9c62-4945-8150-f7b1c44f35c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:52.147238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce403bc-9c62-4945-8150-f7b1c44f35c2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:52.157496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 442/885] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:41:52 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:41:52.163816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a36f92-ace3-4d29-86e6-708755e3e663 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:52.173255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a36f92-ace3-4d29-86e6-708755e3e663 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:52.177644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047b7c-f82e-4779-89e1-632ac0734ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:52.178361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047b7c-f82e-4779-89e1-632ac0734ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:52.178648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047b7c-f82e-4779-89e1-632ac0734ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:52.178928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047b7c-f82e-4779-89e1-632ac0734ec4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:52.190693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95047b7c-f82e-4779-89e1-632ac0734ec4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:52.216950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95047b7c-f82e-4779-89e1-632ac0734ec4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:52.235385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-95047b7c-f82e-4779-89e1-632ac0734ec4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:52.236525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 444/886] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:52.242849 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce403bc-9c62-4945-8150-f7b1c44f35c2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:52.251659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce403bc-9c62-4945-8150-f7b1c44f35c2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:52.255850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779aaf6-73a3-4112-9112-7639e6b118c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:52.256433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779aaf6-73a3-4112-9112-7639e6b118c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:52.256722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779aaf6-73a3-4112-9112-7639e6b118c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:52.257004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779aaf6-73a3-4112-9112-7639e6b118c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:52.257689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779aaf6-73a3-4112-9112-7639e6b118c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:52.257993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779aaf6-73a3-4112-9112-7639e6b118c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:52.284584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779aaf6-73a3-4112-9112-7639e6b118c9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:52.298645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 443/887] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:41:52.304464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047b7c-f82e-4779-89e1-632ac0734ec4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:52.313795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047b7c-f82e-4779-89e1-632ac0734ec4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:52.317846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd7b03-a79f-442e-8fef-fd17b52b21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:52.318558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7b03-a79f-442e-8fef-fd17b52b21ef admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:52.318847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7b03-a79f-442e-8fef-fd17b52b21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:52.319130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd7b03-a79f-442e-8fef-fd17b52b21ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:52.328497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd7b03-a79f-442e-8fef-fd17b52b21ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:52.354658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd7b03-a79f-442e-8fef-fd17b52b21ef admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:52.368489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-50fd7b03-a79f-442e-8fef-fd17b52b21ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:41:52.369589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 445/888] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:52.375953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779aaf6-73a3-4112-9112-7639e6b118c9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:52.385343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779aaf6-73a3-4112-9112-7639e6b118c9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:52.390678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3598954-c152-40d7-8178-8590191c5a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:52.391271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3598954-c152-40d7-8178-8590191c5a62 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:52.391600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3598954-c152-40d7-8178-8590191c5a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:52.391888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3598954-c152-40d7-8178-8590191c5a62 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:52.392635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3598954-c152-40d7-8178-8590191c5a62 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:52.392939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3598954-c152-40d7-8178-8590191c5a62 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:52.419612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3598954-c152-40d7-8178-8590191c5a62 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:52.433017 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 444/889] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:52.438908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd7b03-a79f-442e-8fef-fd17b52b21ef admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:52.448090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd7b03-a79f-442e-8fef-fd17b52b21ef admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:52.452866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fb975-4bab-400c-98ca-422e5460d028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:52.453431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb975-4bab-400c-98ca-422e5460d028 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:52.453719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb975-4bab-400c-98ca-422e5460d028 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:52.454000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fb975-4bab-400c-98ca-422e5460d028 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:52.454773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb975-4bab-400c-98ca-422e5460d028 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=e99d0fbbc86b4a629b9fffb4d9565216) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:52.455076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb975-4bab-400c-98ca-422e5460d028 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:52.481193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fb975-4bab-400c-98ca-422e5460d028 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:52.495407 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 446/890] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:41:52 2022] GET /identity/v3/role_assignments?user.id=e99d0fbbc86b4a629b9fffb4d9565216&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:54.464080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e67613-a03c-4acc-a436-84341e304f47 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:54.464637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e67613-a03c-4acc-a436-84341e304f47 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:54.464637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e67613-a03c-4acc-a436-84341e304f47 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:54.466214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 445/891] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:54.471573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820046cc-0101-4e05-9751-b293bd9b07ae None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:54.472037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820046cc-0101-4e05-9751-b293bd9b07ae None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:54.472184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820046cc-0101-4e05-9751-b293bd9b07ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:54.495233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-820046cc-0101-4e05-9751-b293bd9b07ae None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:54.496389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-820046cc-0101-4e05-9751-b293bd9b07ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:54.503951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 447/892] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:54.530892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e67613-a03c-4acc-a436-84341e304f47 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:54.544050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e67613-a03c-4acc-a436-84341e304f47 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:54.548730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a23fd-0b31-453d-aee0-7f4635ae5471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:54.549540 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a23fd-0b31-453d-aee0-7f4635ae5471 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:54.550213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a23fd-0b31-453d-aee0-7f4635ae5471 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:54.550213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a23fd-0b31-453d-aee0-7f4635ae5471 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:54.566744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a23fd-0b31-453d-aee0-7f4635ae5471 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:41:54.573256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-256a23fd-0b31-453d-aee0-7f4635ae5471 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:41:54.574385 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 446/893] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:54.581162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820046cc-0101-4e05-9751-b293bd9b07ae None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:54.590117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820046cc-0101-4e05-9751-b293bd9b07ae None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:54.595034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbb06b-1253-4a48-b43d-c7dfd1ffd1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:54.595661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbb06b-1253-4a48-b43d-c7dfd1ffd1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:54.595954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbb06b-1253-4a48-b43d-c7dfd1ffd1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:54.596235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbb06b-1253-4a48-b43d-c7dfd1ffd1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:54.597177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbb06b-1253-4a48-b43d-c7dfd1ffd1e2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:54.597619 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbb06b-1253-4a48-b43d-c7dfd1ffd1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:54.622885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbb06b-1253-4a48-b43d-c7dfd1ffd1e2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:54.631647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 448/894] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:41:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:54.637389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a23fd-0b31-453d-aee0-7f4635ae5471 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:54.648315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a23fd-0b31-453d-aee0-7f4635ae5471 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:54.652427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8ac06-3b81-4891-a247-dfb07db11cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:54.653164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8ac06-3b81-4891-a247-dfb07db11cff admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:54.653463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8ac06-3b81-4891-a247-dfb07db11cff admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:54.653741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8ac06-3b81-4891-a247-dfb07db11cff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:54.665946 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8ac06-3b81-4891-a247-dfb07db11cff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:54.691732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8ac06-3b81-4891-a247-dfb07db11cff admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:54.711090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b1d8ac06-3b81-4891-a247-dfb07db11cff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:54.712197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 447/895] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:54.719143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbb06b-1253-4a48-b43d-c7dfd1ffd1e2 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:54.728270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbb06b-1253-4a48-b43d-c7dfd1ffd1e2 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:54.732316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3f918-4c92-456a-9ef9-d330acddb0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:54.732993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f918-4c92-456a-9ef9-d330acddb0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:54.733334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f918-4c92-456a-9ef9-d330acddb0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:54.733555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3f918-4c92-456a-9ef9-d330acddb0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:54.734226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3f918-4c92-456a-9ef9-d330acddb0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:54.734522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3f918-4c92-456a-9ef9-d330acddb0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:54.760213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3f918-4c92-456a-9ef9-d330acddb0f0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:54.773574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 449/896] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:54.779232 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8ac06-3b81-4891-a247-dfb07db11cff admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:54.789196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8ac06-3b81-4891-a247-dfb07db11cff admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:54.793301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98edb-5f44-42e9-aa26-06e4a7f90491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:54.794004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98edb-5f44-42e9-aa26-06e4a7f90491 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:54.794288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98edb-5f44-42e9-aa26-06e4a7f90491 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:54.794606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be98edb-5f44-42e9-aa26-06e4a7f90491 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:54.807761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98edb-5f44-42e9-aa26-06e4a7f90491 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:54.835659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be98edb-5f44-42e9-aa26-06e4a7f90491 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:54.853469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-9be98edb-5f44-42e9-aa26-06e4a7f90491 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 18 12:41:54.854539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 448/897] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:41:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:54.861481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3f918-4c92-456a-9ef9-d330acddb0f0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:54.870769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3f918-4c92-456a-9ef9-d330acddb0f0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:54.875882 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780bced-73f0-416b-9c69-d2c9c6ec3402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:54.876538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780bced-73f0-416b-9c69-d2c9c6ec3402 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:54.876824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780bced-73f0-416b-9c69-d2c9c6ec3402 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:54.877105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780bced-73f0-416b-9c69-d2c9c6ec3402 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:54.877887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780bced-73f0-416b-9c69-d2c9c6ec3402 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:54.878185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780bced-73f0-416b-9c69-d2c9c6ec3402 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:54.904884 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780bced-73f0-416b-9c69-d2c9c6ec3402 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:54.937609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 450/898] 10.222.0.87 () {56 vars in 1156 bytes} [Tue Jan 18 12:41:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:41:54.943415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98edb-5f44-42e9-aa26-06e4a7f90491 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:54.953780 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be98edb-5f44-42e9-aa26-06e4a7f90491 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:54.957912 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb1a7-593f-420a-935e-d449630fd250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:54.958618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb1a7-593f-420a-935e-d449630fd250 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:54.958903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb1a7-593f-420a-935e-d449630fd250 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:54.959181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effb1a7-593f-420a-935e-d449630fd250 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:54.971618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb1a7-593f-420a-935e-d449630fd250 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:54.997182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effb1a7-593f-420a-935e-d449630fd250 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:55.015213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-1effb1a7-593f-420a-935e-d449630fd250 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:55.016325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 449/899] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:41:55.022192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780bced-73f0-416b-9c69-d2c9c6ec3402 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:55.031923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780bced-73f0-416b-9c69-d2c9c6ec3402 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:55.036002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34c44-4d5f-4232-865a-fd36c38e59e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:55.036576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34c44-4d5f-4232-865a-fd36c38e59e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:55.036874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34c44-4d5f-4232-865a-fd36c38e59e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:55.037140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb34c44-4d5f-4232-865a-fd36c38e59e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:55.037850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34c44-4d5f-4232-865a-fd36c38e59e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:55.038147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34c44-4d5f-4232-865a-fd36c38e59e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:55.064328 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb34c44-4d5f-4232-865a-fd36c38e59e3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:55.077669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 451/900] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:55.083424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb1a7-593f-420a-935e-d449630fd250 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:55.093836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effb1a7-593f-420a-935e-d449630fd250 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:55.097918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd69a70-c798-4bae-aa72-d8afa9d75b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:55.098635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd69a70-c798-4bae-aa72-d8afa9d75b13 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:55.098924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd69a70-c798-4bae-aa72-d8afa9d75b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:55.099207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd69a70-c798-4bae-aa72-d8afa9d75b13 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:55.109320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd69a70-c798-4bae-aa72-d8afa9d75b13 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:55.135932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd69a70-c798-4bae-aa72-d8afa9d75b13 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:55.149830 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-7cd69a70-c798-4bae-aa72-d8afa9d75b13 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:41:55.150905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 450/901] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:41:55.156856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34c44-4d5f-4232-865a-fd36c38e59e3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:55.166277 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb34c44-4d5f-4232-865a-fd36c38e59e3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:55.170911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1a4fe-0c67-47cd-b863-594b7df66773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:55.171456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1a4fe-0c67-47cd-b863-594b7df66773 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:55.171747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1a4fe-0c67-47cd-b863-594b7df66773 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:55.172028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1a4fe-0c67-47cd-b863-594b7df66773 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:55.172752 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1a4fe-0c67-47cd-b863-594b7df66773 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:55.173051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1a4fe-0c67-47cd-b863-594b7df66773 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:55.198968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1a4fe-0c67-47cd-b863-594b7df66773 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:55.212183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 452/902] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:41:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:41:55.218140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd69a70-c798-4bae-aa72-d8afa9d75b13 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:55.227534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd69a70-c798-4bae-aa72-d8afa9d75b13 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:55.231510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8427f28-06ef-408b-8ef5-40bd96b40e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:55.232342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8427f28-06ef-408b-8ef5-40bd96b40e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:55.232630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8427f28-06ef-408b-8ef5-40bd96b40e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:55.233426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8427f28-06ef-408b-8ef5-40bd96b40e97 admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/e99d0fbbc86b4a629b9fffb4d9565216/roles/021156a7816c4a96874e0a699028ceef` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:55.254107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8427f28-06ef-408b-8ef5-40bd96b40e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=e99d0fbbc86b4a629b9fffb4d9565216, role_id=021156a7816c4a96874e0a699028ceef)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:55.280083 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8427f28-06ef-408b-8ef5-40bd96b40e97 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:55.355912 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 451/903] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:41:55 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/e99d0fbbc86b4a629b9fffb4d9565216/roles/021156a7816c4a96874e0a699028ceef => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 12:41:57.322657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58ddb0-9827-40d5-bb6c-3794cb9800fb None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:57.323183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58ddb0-9827-40d5-bb6c-3794cb9800fb None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:57.323292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58ddb0-9827-40d5-bb6c-3794cb9800fb None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:57.324942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 453/904] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:41:57.330187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faab11-be22-4b3e-9d81-ae370181f286 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:57.330574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faab11-be22-4b3e-9d81-ae370181f286 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:57.330756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faab11-be22-4b3e-9d81-ae370181f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:57.353122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-32faab11-be22-4b3e-9d81-ae370181f286 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:41:57.354184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-32faab11-be22-4b3e-9d81-ae370181f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:41:57.418178 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 452/905] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:41:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:41:57.440918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58ddb0-9827-40d5-bb6c-3794cb9800fb None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:57.452805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58ddb0-9827-40d5-bb6c-3794cb9800fb None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:57.456715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e2ed5-fd88-4162-b691-e37e0125c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:57.457463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e2ed5-fd88-4162-b691-e37e0125c384 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:57.457759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e2ed5-fd88-4162-b691-e37e0125c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:57.458036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e2ed5-fd88-4162-b691-e37e0125c384 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:57.469376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e2ed5-fd88-4162-b691-e37e0125c384 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:41:57.475713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-a10e2ed5-fd88-4162-b691-e37e0125c384 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:41:57.476790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 454/906] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:41:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:57.482689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faab11-be22-4b3e-9d81-ae370181f286 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:57.491875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faab11-be22-4b3e-9d81-ae370181f286 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:57.495962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c43fae-ebf5-4b92-a4a0-2e4774b99478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:57.496554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c43fae-ebf5-4b92-a4a0-2e4774b99478 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:57.496842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c43fae-ebf5-4b92-a4a0-2e4774b99478 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:57.497131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c43fae-ebf5-4b92-a4a0-2e4774b99478 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:57.497843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c43fae-ebf5-4b92-a4a0-2e4774b99478 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:57.498145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c43fae-ebf5-4b92-a4a0-2e4774b99478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:57.523604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c43fae-ebf5-4b92-a4a0-2e4774b99478 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:57.533031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 453/907] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:57.538796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e2ed5-fd88-4162-b691-e37e0125c384 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:57.549910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e2ed5-fd88-4162-b691-e37e0125c384 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:57.554181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff408b3-1429-4762-b9cd-05247f469db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:57.554925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff408b3-1429-4762-b9cd-05247f469db0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:57.555211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff408b3-1429-4762-b9cd-05247f469db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:57.555522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff408b3-1429-4762-b9cd-05247f469db0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:57.566509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff408b3-1429-4762-b9cd-05247f469db0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:57.592925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff408b3-1429-4762-b9cd-05247f469db0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:57.617615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-aff408b3-1429-4762-b9cd-05247f469db0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:57.617615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 455/908] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:57.619571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c43fae-ebf5-4b92-a4a0-2e4774b99478 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:57.629383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c43fae-ebf5-4b92-a4a0-2e4774b99478 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:57.633368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b81b0-24ed-41a2-b094-6961307ae283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:57.633945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b81b0-24ed-41a2-b094-6961307ae283 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:57.634229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b81b0-24ed-41a2-b094-6961307ae283 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:57.634505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b81b0-24ed-41a2-b094-6961307ae283 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:57.635234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b81b0-24ed-41a2-b094-6961307ae283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:57.635555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b81b0-24ed-41a2-b094-6961307ae283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:57.661563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b81b0-24ed-41a2-b094-6961307ae283 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:57.674936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 454/909] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:57.680662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff408b3-1429-4762-b9cd-05247f469db0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:57.690458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff408b3-1429-4762-b9cd-05247f469db0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:57.694574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d810ffa-57f3-4192-b4c1-88694bdb29fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:57.695282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d810ffa-57f3-4192-b4c1-88694bdb29fa admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:57.695607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d810ffa-57f3-4192-b4c1-88694bdb29fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:57.695886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d810ffa-57f3-4192-b4c1-88694bdb29fa admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:57.786607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d810ffa-57f3-4192-b4c1-88694bdb29fa admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:57.813913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d810ffa-57f3-4192-b4c1-88694bdb29fa admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:57.832838 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-5d810ffa-57f3-4192-b4c1-88694bdb29fa admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 18 12:41:57.833944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 456/910] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:41:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:57.839785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b81b0-24ed-41a2-b094-6961307ae283 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:57.849439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b81b0-24ed-41a2-b094-6961307ae283 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:57.853607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4984a1-cfc3-4879-8c45-6100d05e1ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:57.854203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4984a1-cfc3-4879-8c45-6100d05e1ffe admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:57.854490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4984a1-cfc3-4879-8c45-6100d05e1ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:57.854771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4984a1-cfc3-4879-8c45-6100d05e1ffe admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:57.855598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4984a1-cfc3-4879-8c45-6100d05e1ffe admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:57.855895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4984a1-cfc3-4879-8c45-6100d05e1ffe admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:57.882853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4984a1-cfc3-4879-8c45-6100d05e1ffe admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:57.911954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 455/911] 10.222.0.87 () {56 vars in 1156 bytes} [Tue Jan 18 12:41:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:57.917896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d810ffa-57f3-4192-b4c1-88694bdb29fa admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:57.928318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d810ffa-57f3-4192-b4c1-88694bdb29fa admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:57.933418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fdc91-da5d-44df-bb6e-38995f5c0914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:57.933994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fdc91-da5d-44df-bb6e-38995f5c0914 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:57.934283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fdc91-da5d-44df-bb6e-38995f5c0914 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:57.934564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fdc91-da5d-44df-bb6e-38995f5c0914 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:57.943357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fdc91-da5d-44df-bb6e-38995f5c0914 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:57.972369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fdc91-da5d-44df-bb6e-38995f5c0914 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:57.981611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 457/912] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:41:57 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:41:57.988005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4984a1-cfc3-4879-8c45-6100d05e1ffe admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:58.005227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4984a1-cfc3-4879-8c45-6100d05e1ffe admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:58.009277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8661b-f8db-432c-b9c6-bc580af3df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:58.009991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8661b-f8db-432c-b9c6-bc580af3df9a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:58.010275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8661b-f8db-432c-b9c6-bc580af3df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:58.010556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8661b-f8db-432c-b9c6-bc580af3df9a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:58.030374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8661b-f8db-432c-b9c6-bc580af3df9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:58.056949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8661b-f8db-432c-b9c6-bc580af3df9a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:58.074949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-54f8661b-f8db-432c-b9c6-bc580af3df9a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:41:58.080756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 456/913] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:58.081811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fdc91-da5d-44df-bb6e-38995f5c0914 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:58.090409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fdc91-da5d-44df-bb6e-38995f5c0914 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:58.094691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32264b92-b934-4b4d-8bd5-498fd58ef0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:58.095263 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32264b92-b934-4b4d-8bd5-498fd58ef0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:58.095575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32264b92-b934-4b4d-8bd5-498fd58ef0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:58.095854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32264b92-b934-4b4d-8bd5-498fd58ef0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:58.096522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32264b92-b934-4b4d-8bd5-498fd58ef0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:58.096820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32264b92-b934-4b4d-8bd5-498fd58ef0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:58.122626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32264b92-b934-4b4d-8bd5-498fd58ef0c4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:58.136136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 458/914] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:41:58.142082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8661b-f8db-432c-b9c6-bc580af3df9a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:58.152961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8661b-f8db-432c-b9c6-bc580af3df9a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:58.158053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c62454-5281-4951-b20d-8c2579882a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:58.158875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c62454-5281-4951-b20d-8c2579882a61 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:58.159210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c62454-5281-4951-b20d-8c2579882a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:58.159576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c62454-5281-4951-b20d-8c2579882a61 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:58.172378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c62454-5281-4951-b20d-8c2579882a61 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:58.204068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c62454-5281-4951-b20d-8c2579882a61 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:58.219367 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b7c62454-5281-4951-b20d-8c2579882a61 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:41:58.220461 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 457/915] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:41:58.226316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32264b92-b934-4b4d-8bd5-498fd58ef0c4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:58.237643 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32264b92-b934-4b4d-8bd5-498fd58ef0c4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:58.243497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed485ab-b4fa-4cd2-a921-dd964a841ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:58.244348 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed485ab-b4fa-4cd2-a921-dd964a841ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:58.244774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed485ab-b4fa-4cd2-a921-dd964a841ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:58.245191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed485ab-b4fa-4cd2-a921-dd964a841ce6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:58.246310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed485ab-b4fa-4cd2-a921-dd964a841ce6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:58.246766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed485ab-b4fa-4cd2-a921-dd964a841ce6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:58.283008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed485ab-b4fa-4cd2-a921-dd964a841ce6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:58.298229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 459/916] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:41:58.304308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c62454-5281-4951-b20d-8c2579882a61 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:41:58.314172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c62454-5281-4951-b20d-8c2579882a61 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:41:58.318263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fd87d-e296-489f-a5d7-dcf3d63d3864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:41:58.318839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fd87d-e296-489f-a5d7-dcf3d63d3864 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:41:58.319124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fd87d-e296-489f-a5d7-dcf3d63d3864 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:41:58.319440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fd87d-e296-489f-a5d7-dcf3d63d3864 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:41:58.320223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fd87d-e296-489f-a5d7-dcf3d63d3864 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=e99d0fbbc86b4a629b9fffb4d9565216) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:41:58.320525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fd87d-e296-489f-a5d7-dcf3d63d3864 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:41:58.346943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fd87d-e296-489f-a5d7-dcf3d63d3864 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:41:58.352897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 458/917] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:41:58 2022] GET /identity/v3/role_assignments?user.id=e99d0fbbc86b4a629b9fffb4d9565216&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:00.399788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b6b2e-0c2e-4859-bc0a-e18c936496d5 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:00.400295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b6b2e-0c2e-4859-bc0a-e18c936496d5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:00.400295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b6b2e-0c2e-4859-bc0a-e18c936496d5 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:00.401925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 460/918] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:00.407871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987afc2-870a-41eb-96d7-2569ee758f2f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:00.408320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987afc2-870a-41eb-96d7-2569ee758f2f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:00.408473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987afc2-870a-41eb-96d7-2569ee758f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:00.514987 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-8987afc2-870a-41eb-96d7-2569ee758f2f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:00.515882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8987afc2-870a-41eb-96d7-2569ee758f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:00.522859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 459/919] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:00.548521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b6b2e-0c2e-4859-bc0a-e18c936496d5 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:00.561086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b6b2e-0c2e-4859-bc0a-e18c936496d5 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:00.565726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade2737-4790-44bf-a2c9-97d22b10aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:00.566510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade2737-4790-44bf-a2c9-97d22b10aaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:00.566824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade2737-4790-44bf-a2c9-97d22b10aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:00.567143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade2737-4790-44bf-a2c9-97d22b10aaa5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:00.579983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade2737-4790-44bf-a2c9-97d22b10aaa5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:42:00.595031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-0ade2737-4790-44bf-a2c9-97d22b10aaa5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:42:00.596318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 461/920] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:00.602605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987afc2-870a-41eb-96d7-2569ee758f2f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:00.612314 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987afc2-870a-41eb-96d7-2569ee758f2f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:00.616514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebca90-2212-444a-9270-2953717706cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:00.617105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebca90-2212-444a-9270-2953717706cd admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:00.617392 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebca90-2212-444a-9270-2953717706cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:00.617676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebca90-2212-444a-9270-2953717706cd admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:00.618388 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebca90-2212-444a-9270-2953717706cd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:00.618689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebca90-2212-444a-9270-2953717706cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:00.644762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebca90-2212-444a-9270-2953717706cd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:00.653708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 460/921] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:42:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:00.659959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade2737-4790-44bf-a2c9-97d22b10aaa5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:00.669974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade2737-4790-44bf-a2c9-97d22b10aaa5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:00.674109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141d7fe-bf4c-4c08-af02-c204623a204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:00.674818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141d7fe-bf4c-4c08-af02-c204623a204d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:00.675107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141d7fe-bf4c-4c08-af02-c204623a204d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:00.675421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141d7fe-bf4c-4c08-af02-c204623a204d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:00.686793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141d7fe-bf4c-4c08-af02-c204623a204d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:00.712151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141d7fe-bf4c-4c08-af02-c204623a204d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:00.730606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-e141d7fe-bf4c-4c08-af02-c204623a204d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:42:00.731717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 462/922] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:00.738217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebca90-2212-444a-9270-2953717706cd admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:00.747920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebca90-2212-444a-9270-2953717706cd admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:00.752929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc9fe4-0ac7-42f3-983e-b2f24b3a3d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:00.753562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc9fe4-0ac7-42f3-983e-b2f24b3a3d2d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:00.753846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc9fe4-0ac7-42f3-983e-b2f24b3a3d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:00.754126 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc9fe4-0ac7-42f3-983e-b2f24b3a3d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:00.754806 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc9fe4-0ac7-42f3-983e-b2f24b3a3d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:00.755103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc9fe4-0ac7-42f3-983e-b2f24b3a3d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:00.781058 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc9fe4-0ac7-42f3-983e-b2f24b3a3d2d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:00.793976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 461/923] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:00.800356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141d7fe-bf4c-4c08-af02-c204623a204d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:00.809584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141d7fe-bf4c-4c08-af02-c204623a204d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:00.814408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d89754-0682-483e-826a-693a9afdc278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:00.815119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d89754-0682-483e-826a-693a9afdc278 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:00.815442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d89754-0682-483e-826a-693a9afdc278 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:00.815723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d89754-0682-483e-826a-693a9afdc278 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:00.828789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d89754-0682-483e-826a-693a9afdc278 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:00.861802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d89754-0682-483e-826a-693a9afdc278 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:00.880096 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-c3d89754-0682-483e-826a-693a9afdc278 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 18 12:42:00.881191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 463/924] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:00.887035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc9fe4-0ac7-42f3-983e-b2f24b3a3d2d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:00.897996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc9fe4-0ac7-42f3-983e-b2f24b3a3d2d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:00.902534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5488ad-a68a-43c2-9888-2de8c80b555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:00.903159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5488ad-a68a-43c2-9888-2de8c80b555d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:00.903516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5488ad-a68a-43c2-9888-2de8c80b555d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:00.903885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5488ad-a68a-43c2-9888-2de8c80b555d admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:00.904662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5488ad-a68a-43c2-9888-2de8c80b555d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:00.905131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5488ad-a68a-43c2-9888-2de8c80b555d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:00.933648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5488ad-a68a-43c2-9888-2de8c80b555d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:00.964018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 462/925] 10.222.0.87 () {56 vars in 1156 bytes} [Tue Jan 18 12:42:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:42:00.969957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d89754-0682-483e-826a-693a9afdc278 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:00.979600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d89754-0682-483e-826a-693a9afdc278 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:00.985379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f80da-774e-4ceb-880a-65fc7ca7dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:00.985545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f80da-774e-4ceb-880a-65fc7ca7dec2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:00.985706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f80da-774e-4ceb-880a-65fc7ca7dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:00.985989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f80da-774e-4ceb-880a-65fc7ca7dec2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:00.994094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f80da-774e-4ceb-880a-65fc7ca7dec2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:01.020778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f80da-774e-4ceb-880a-65fc7ca7dec2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:01.031368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 464/926] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:42:00 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:42:01.037504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5488ad-a68a-43c2-9888-2de8c80b555d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:01.049054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5488ad-a68a-43c2-9888-2de8c80b555d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:01.053322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465b07e-1a80-4b25-bf54-685958930b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:01.054047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465b07e-1a80-4b25-bf54-685958930b39 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:01.054339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465b07e-1a80-4b25-bf54-685958930b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:01.054621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465b07e-1a80-4b25-bf54-685958930b39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:01.066945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465b07e-1a80-4b25-bf54-685958930b39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:01.094647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2465b07e-1a80-4b25-bf54-685958930b39 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:01.112607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-2465b07e-1a80-4b25-bf54-685958930b39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:42:01.113733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 463/927] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:01.119546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f80da-774e-4ceb-880a-65fc7ca7dec2 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:01.128221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f80da-774e-4ceb-880a-65fc7ca7dec2 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:01.132570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9878b5-b4d0-46cd-aec3-a313d9892719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:01.133232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9878b5-b4d0-46cd-aec3-a313d9892719 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:01.133523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9878b5-b4d0-46cd-aec3-a313d9892719 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:01.133805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9878b5-b4d0-46cd-aec3-a313d9892719 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:01.134486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9878b5-b4d0-46cd-aec3-a313d9892719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:01.134789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9878b5-b4d0-46cd-aec3-a313d9892719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:01.161492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9878b5-b4d0-46cd-aec3-a313d9892719 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:01.174852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 465/928] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:01.180656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465b07e-1a80-4b25-bf54-685958930b39 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:01.194555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2465b07e-1a80-4b25-bf54-685958930b39 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:01.198672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0a7b1-5341-47f6-8fe0-160c6ad52a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:01.199423 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a7b1-5341-47f6-8fe0-160c6ad52a05 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:01.199714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a7b1-5341-47f6-8fe0-160c6ad52a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:01.199996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0a7b1-5341-47f6-8fe0-160c6ad52a05 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:01.209607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0a7b1-5341-47f6-8fe0-160c6ad52a05 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:01.235255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0a7b1-5341-47f6-8fe0-160c6ad52a05 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:01.249605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-fcb0a7b1-5341-47f6-8fe0-160c6ad52a05 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:42:01.250704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 464/929] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:42:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:01.256615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9878b5-b4d0-46cd-aec3-a313d9892719 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:01.267577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9878b5-b4d0-46cd-aec3-a313d9892719 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:01.271884 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d352c97-50ce-4e40-835a-99d5468a9cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:01.272469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d352c97-50ce-4e40-835a-99d5468a9cab admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:01.272759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d352c97-50ce-4e40-835a-99d5468a9cab admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:01.273035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d352c97-50ce-4e40-835a-99d5468a9cab admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:01.273777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d352c97-50ce-4e40-835a-99d5468a9cab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:01.274077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d352c97-50ce-4e40-835a-99d5468a9cab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:01.299817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d352c97-50ce-4e40-835a-99d5468a9cab admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:01.313561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 466/930] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:42:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:01.321589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0a7b1-5341-47f6-8fe0-160c6ad52a05 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:01.335788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0a7b1-5341-47f6-8fe0-160c6ad52a05 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:01.341541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78fc9f-d3c2-496d-96bb-a207a9246c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:01.342486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78fc9f-d3c2-496d-96bb-a207a9246c68 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:01.342959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78fc9f-d3c2-496d-96bb-a207a9246c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:01.343786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78fc9f-d3c2-496d-96bb-a207a9246c68 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:01.344943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78fc9f-d3c2-496d-96bb-a207a9246c68 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=e99d0fbbc86b4a629b9fffb4d9565216) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:01.345448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78fc9f-d3c2-496d-96bb-a207a9246c68 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:01.378907 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78fc9f-d3c2-496d-96bb-a207a9246c68 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:01.384986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 465/931] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:42:01 2022] GET /identity/v3/role_assignments?user.id=e99d0fbbc86b4a629b9fffb4d9565216&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 259 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:03.406672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613a8b5-af8f-4bfb-8483-4662c7f38265 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.407165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613a8b5-af8f-4bfb-8483-4662c7f38265 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.407343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613a8b5-af8f-4bfb-8483-4662c7f38265 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.409069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 467/932] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:03.414787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0ae94-fedc-4d8d-b4ad-203d8106dab9 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.415208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0ae94-fedc-4d8d-b4ad-203d8106dab9 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.415751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0ae94-fedc-4d8d-b4ad-203d8106dab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.438250 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d3a0ae94-fedc-4d8d-b4ad-203d8106dab9 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:03.439403 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d3a0ae94-fedc-4d8d-b4ad-203d8106dab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:03.446246 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 466/933] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:03 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:03.468625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613a8b5-af8f-4bfb-8483-4662c7f38265 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:03.480197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613a8b5-af8f-4bfb-8483-4662c7f38265 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:03.484278 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18ec5b-8bf6-4aa6-b005-884dd1c6661a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:03.484985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18ec5b-8bf6-4aa6-b005-884dd1c6661a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.485274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18ec5b-8bf6-4aa6-b005-884dd1c6661a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.485555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18ec5b-8bf6-4aa6-b005-884dd1c6661a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.497235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18ec5b-8bf6-4aa6-b005-884dd1c6661a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:42:03.504206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-bd18ec5b-8bf6-4aa6-b005-884dd1c6661a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:42:03.505352 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 468/934] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:03.511548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0ae94-fedc-4d8d-b4ad-203d8106dab9 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:03.520929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0ae94-fedc-4d8d-b4ad-203d8106dab9 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:03.525159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf29a8-6a5e-4060-9b69-b66a3414af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:03.525753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf29a8-6a5e-4060-9b69-b66a3414af09 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.526041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf29a8-6a5e-4060-9b69-b66a3414af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.526322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf29a8-6a5e-4060-9b69-b66a3414af09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.527028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf29a8-6a5e-4060-9b69-b66a3414af09 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:03.527356 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf29a8-6a5e-4060-9b69-b66a3414af09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:03.552983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf29a8-6a5e-4060-9b69-b66a3414af09 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:03.562476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 467/935] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:42:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:03.568218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18ec5b-8bf6-4aa6-b005-884dd1c6661a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:03.579144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18ec5b-8bf6-4aa6-b005-884dd1c6661a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:03.583444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73887a1f-18fd-4fd1-aedb-88e837c32b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:03.584153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73887a1f-18fd-4fd1-aedb-88e837c32b11 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.584444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73887a1f-18fd-4fd1-aedb-88e837c32b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.584729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73887a1f-18fd-4fd1-aedb-88e837c32b11 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.596271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73887a1f-18fd-4fd1-aedb-88e837c32b11 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:03.622193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73887a1f-18fd-4fd1-aedb-88e837c32b11 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:03.641720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-73887a1f-18fd-4fd1-aedb-88e837c32b11 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:42:03.642837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 469/936] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:03.648586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf29a8-6a5e-4060-9b69-b66a3414af09 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:03.658105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf29a8-6a5e-4060-9b69-b66a3414af09 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:03.662129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd343e-7b93-465a-a46a-8cbbdf9335d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:03.662705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd343e-7b93-465a-a46a-8cbbdf9335d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.662992 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd343e-7b93-465a-a46a-8cbbdf9335d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.663276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd343e-7b93-465a-a46a-8cbbdf9335d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.664025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd343e-7b93-465a-a46a-8cbbdf9335d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:03.664327 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd343e-7b93-465a-a46a-8cbbdf9335d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:03.690460 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd343e-7b93-465a-a46a-8cbbdf9335d6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:03.703690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 468/937] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:42:03.709392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73887a1f-18fd-4fd1-aedb-88e837c32b11 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:03.718764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73887a1f-18fd-4fd1-aedb-88e837c32b11 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:03.723084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc9b5-cbde-4d09-9eaf-9f2e1c557fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:03.723836 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc9b5-cbde-4d09-9eaf-9f2e1c557fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.724128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc9b5-cbde-4d09-9eaf-9f2e1c557fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.724413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164cc9b5-cbde-4d09-9eaf-9f2e1c557fd7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.738458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc9b5-cbde-4d09-9eaf-9f2e1c557fd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:03.765156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164cc9b5-cbde-4d09-9eaf-9f2e1c557fd7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:03.782675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-164cc9b5-cbde-4d09-9eaf-9f2e1c557fd7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 18 12:42:03.783792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 470/938] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:03.790293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd343e-7b93-465a-a46a-8cbbdf9335d6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:03.800227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd343e-7b93-465a-a46a-8cbbdf9335d6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:03.804297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edfd3-8713-4cce-b36c-364b8bbb6d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:03.804890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edfd3-8713-4cce-b36c-364b8bbb6d4d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.805214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edfd3-8713-4cce-b36c-364b8bbb6d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.805497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451edfd3-8713-4cce-b36c-364b8bbb6d4d admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.806293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451edfd3-8713-4cce-b36c-364b8bbb6d4d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:03.806593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451edfd3-8713-4cce-b36c-364b8bbb6d4d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:03.832581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451edfd3-8713-4cce-b36c-364b8bbb6d4d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:03.861531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 469/939] 10.222.0.87 () {56 vars in 1156 bytes} [Tue Jan 18 12:42:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:03.867136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc9b5-cbde-4d09-9eaf-9f2e1c557fd7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:03.877639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164cc9b5-cbde-4d09-9eaf-9f2e1c557fd7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:03.881924 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31a7bd-4057-4427-baff-931d0e5b3abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:03.882644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31a7bd-4057-4427-baff-931d0e5b3abd admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.882928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31a7bd-4057-4427-baff-931d0e5b3abd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.883209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31a7bd-4057-4427-baff-931d0e5b3abd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.895784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31a7bd-4057-4427-baff-931d0e5b3abd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:03.922920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31a7bd-4057-4427-baff-931d0e5b3abd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:03.940861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-7d31a7bd-4057-4427-baff-931d0e5b3abd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:42:03.941959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 471/940] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:03.947890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edfd3-8713-4cce-b36c-364b8bbb6d4d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:03.957684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451edfd3-8713-4cce-b36c-364b8bbb6d4d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:03.961801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc22c14-231d-4a42-9f56-39875e25663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:03.962396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc22c14-231d-4a42-9f56-39875e25663a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:03.962685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc22c14-231d-4a42-9f56-39875e25663a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:03.962970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc22c14-231d-4a42-9f56-39875e25663a admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:03.963688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc22c14-231d-4a42-9f56-39875e25663a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:03.963990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc22c14-231d-4a42-9f56-39875e25663a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:03.997536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc22c14-231d-4a42-9f56-39875e25663a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:04.011758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 470/941] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:04.017682 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31a7bd-4057-4427-baff-931d0e5b3abd admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:04.026948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31a7bd-4057-4427-baff-931d0e5b3abd admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:04.031111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c348-a831-4d0f-baa5-b7278ac7570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:04.031855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c348-a831-4d0f-baa5-b7278ac7570a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:04.032142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c348-a831-4d0f-baa5-b7278ac7570a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:04.032421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c348-a831-4d0f-baa5-b7278ac7570a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:04.041588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418c348-a831-4d0f-baa5-b7278ac7570a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:04.068775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418c348-a831-4d0f-baa5-b7278ac7570a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:04.082987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-3418c348-a831-4d0f-baa5-b7278ac7570a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:42:04.084115 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 472/942] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:42:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:04.090077 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc22c14-231d-4a42-9f56-39875e25663a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:04.099720 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc22c14-231d-4a42-9f56-39875e25663a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:04.103736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f1972-3141-46f8-9bd8-35682395cc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:04.104356 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f1972-3141-46f8-9bd8-35682395cc3d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:04.104649 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f1972-3141-46f8-9bd8-35682395cc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:04.104918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f1972-3141-46f8-9bd8-35682395cc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:04.105656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f1972-3141-46f8-9bd8-35682395cc3d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:04.105953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f1972-3141-46f8-9bd8-35682395cc3d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:04.133971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f1972-3141-46f8-9bd8-35682395cc3d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:04.149460 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 471/943] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:42:04.155667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c348-a831-4d0f-baa5-b7278ac7570a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:04.166530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c348-a831-4d0f-baa5-b7278ac7570a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:04.170822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed0d46-d51a-4b7f-b3d1-ac00c650a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:04.172351 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed0d46-d51a-4b7f-b3d1-ac00c650a0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:04.172784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed0d46-d51a-4b7f-b3d1-ac00c650a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:04.173111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed0d46-d51a-4b7f-b3d1-ac00c650a0a3 admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/e99d0fbbc86b4a629b9fffb4d9565216/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:04.174866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed0d46-d51a-4b7f-b3d1-ac00c650a0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=e99d0fbbc86b4a629b9fffb4d9565216, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:04.202999 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed0d46-d51a-4b7f-b3d1-ac00c650a0a3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:04.327957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 473/944] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:42:04 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/e99d0fbbc86b4a629b9fffb4d9565216/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:42:06.387376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caf911-989e-4f1c-a44f-e15e219d0b97 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:06.387874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caf911-989e-4f1c-a44f-e15e219d0b97 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:06.387874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caf911-989e-4f1c-a44f-e15e219d0b97 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:06.389543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 472/945] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:06.394876 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059597ee-d5ee-4317-b96a-9ea0844102c1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:06.395296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059597ee-d5ee-4317-b96a-9ea0844102c1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:06.395484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059597ee-d5ee-4317-b96a-9ea0844102c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:06.418743 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-059597ee-d5ee-4317-b96a-9ea0844102c1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:06.419941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-059597ee-d5ee-4317-b96a-9ea0844102c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:06.484233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 474/946] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:06.508209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caf911-989e-4f1c-a44f-e15e219d0b97 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:06.520011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caf911-989e-4f1c-a44f-e15e219d0b97 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:06.523941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc7cff-62b8-4ffa-9171-08701b0fd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:06.524656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc7cff-62b8-4ffa-9171-08701b0fd8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:06.524945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc7cff-62b8-4ffa-9171-08701b0fd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:06.525218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc7cff-62b8-4ffa-9171-08701b0fd8e0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:06.537221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc7cff-62b8-4ffa-9171-08701b0fd8e0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:42:06.543800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-e7fc7cff-62b8-4ffa-9171-08701b0fd8e0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:42:06.544898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 473/947] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:06.551786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059597ee-d5ee-4317-b96a-9ea0844102c1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:06.560921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059597ee-d5ee-4317-b96a-9ea0844102c1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:06.565478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc47fd-1d6c-4948-bc78-87cd6c534e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:06.566366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc47fd-1d6c-4948-bc78-87cd6c534e23 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:06.566799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc47fd-1d6c-4948-bc78-87cd6c534e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:06.567218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc47fd-1d6c-4948-bc78-87cd6c534e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:06.568310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc47fd-1d6c-4948-bc78-87cd6c534e23 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:06.568766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc47fd-1d6c-4948-bc78-87cd6c534e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:06.600666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc47fd-1d6c-4948-bc78-87cd6c534e23 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:06.614825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 475/948] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:06.620693 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc7cff-62b8-4ffa-9171-08701b0fd8e0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:06.631125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc7cff-62b8-4ffa-9171-08701b0fd8e0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:06.635451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b2774-f91d-4d4e-8e4c-db6f0751facc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:06.636160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b2774-f91d-4d4e-8e4c-db6f0751facc admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:06.636501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b2774-f91d-4d4e-8e4c-db6f0751facc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:06.636788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b2774-f91d-4d4e-8e4c-db6f0751facc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:06.652985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b2774-f91d-4d4e-8e4c-db6f0751facc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:06.681994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b2774-f91d-4d4e-8e4c-db6f0751facc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:06.700785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-6a4b2774-f91d-4d4e-8e4c-db6f0751facc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:42:06.701874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 474/949] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:42:06.708360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc47fd-1d6c-4948-bc78-87cd6c534e23 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:06.718034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc47fd-1d6c-4948-bc78-87cd6c534e23 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:06.723009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5a979-62aa-425f-9db2-426375487f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:06.723623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5a979-62aa-425f-9db2-426375487f6c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:06.723908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5a979-62aa-425f-9db2-426375487f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:06.724186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e5a979-62aa-425f-9db2-426375487f6c admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:06.724857 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5a979-62aa-425f-9db2-426375487f6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:06.725153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5a979-62aa-425f-9db2-426375487f6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:06.750899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e5a979-62aa-425f-9db2-426375487f6c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:06.763614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 476/950] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:06.770917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b2774-f91d-4d4e-8e4c-db6f0751facc admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:06.780206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b2774-f91d-4d4e-8e4c-db6f0751facc admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:06.785211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614130c2-5b92-404b-a3ec-6a9b42fa0033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:06.785915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614130c2-5b92-404b-a3ec-6a9b42fa0033 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:06.786230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614130c2-5b92-404b-a3ec-6a9b42fa0033 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:06.786509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614130c2-5b92-404b-a3ec-6a9b42fa0033 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:06.799300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614130c2-5b92-404b-a3ec-6a9b42fa0033 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:06.825295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614130c2-5b92-404b-a3ec-6a9b42fa0033 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:06.843873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-614130c2-5b92-404b-a3ec-6a9b42fa0033 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 18 12:42:06.845635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 475/951] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:06.851483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5a979-62aa-425f-9db2-426375487f6c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:06.860958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e5a979-62aa-425f-9db2-426375487f6c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:06.865118 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375675a-fa21-430b-8b63-d67f0e0488b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:06.865707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375675a-fa21-430b-8b63-d67f0e0488b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:06.865995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375675a-fa21-430b-8b63-d67f0e0488b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:06.866275 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375675a-fa21-430b-8b63-d67f0e0488b6 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:06.867053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375675a-fa21-430b-8b63-d67f0e0488b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:06.867384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375675a-fa21-430b-8b63-d67f0e0488b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:06.893731 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375675a-fa21-430b-8b63-d67f0e0488b6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:06.923440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 477/952] 10.222.0.87 () {56 vars in 1156 bytes} [Tue Jan 18 12:42:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:06.929138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614130c2-5b92-404b-a3ec-6a9b42fa0033 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:06.939951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614130c2-5b92-404b-a3ec-6a9b42fa0033 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:06.944542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0ce84-172c-4f6c-87c3-04ac13b41ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:06.945522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0ce84-172c-4f6c-87c3-04ac13b41ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:06.945963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0ce84-172c-4f6c-87c3-04ac13b41ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:06.946246 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0ce84-172c-4f6c-87c3-04ac13b41ea0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:06.956511 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0ce84-172c-4f6c-87c3-04ac13b41ea0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:06.982875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0ce84-172c-4f6c-87c3-04ac13b41ea0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:06.992773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 476/953] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:42:06 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:42:06.998732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375675a-fa21-430b-8b63-d67f0e0488b6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:07.008046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375675a-fa21-430b-8b63-d67f0e0488b6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:07.012265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f59736-8243-40ee-bf7b-fde12cdad422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:07.012976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59736-8243-40ee-bf7b-fde12cdad422 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:07.013270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59736-8243-40ee-bf7b-fde12cdad422 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:07.013547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f59736-8243-40ee-bf7b-fde12cdad422 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:07.025597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59736-8243-40ee-bf7b-fde12cdad422 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:07.052279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f59736-8243-40ee-bf7b-fde12cdad422 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:07.069372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-62f59736-8243-40ee-bf7b-fde12cdad422 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:42:07.070489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 478/954] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:07.076185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0ce84-172c-4f6c-87c3-04ac13b41ea0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:07.085510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0ce84-172c-4f6c-87c3-04ac13b41ea0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:07.089820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9adb7-69d2-4dbf-8743-f14e72b07ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:07.090404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9adb7-69d2-4dbf-8743-f14e72b07ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:07.090689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9adb7-69d2-4dbf-8743-f14e72b07ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:07.090968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9adb7-69d2-4dbf-8743-f14e72b07ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:07.091681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9adb7-69d2-4dbf-8743-f14e72b07ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:07.091983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9adb7-69d2-4dbf-8743-f14e72b07ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:07.118267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9adb7-69d2-4dbf-8743-f14e72b07ac1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:07.131745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 477/955] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:07.137531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f59736-8243-40ee-bf7b-fde12cdad422 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:07.147792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f59736-8243-40ee-bf7b-fde12cdad422 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:07.151773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217e6f9-5f38-4ac8-adba-ebd064bbb9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:07.152521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217e6f9-5f38-4ac8-adba-ebd064bbb9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:07.152805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217e6f9-5f38-4ac8-adba-ebd064bbb9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:07.153082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217e6f9-5f38-4ac8-adba-ebd064bbb9b6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:07.161833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217e6f9-5f38-4ac8-adba-ebd064bbb9b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:07.187729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217e6f9-5f38-4ac8-adba-ebd064bbb9b6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:07.202073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-c217e6f9-5f38-4ac8-adba-ebd064bbb9b6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:42:07.203147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 479/956] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:07.209650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9adb7-69d2-4dbf-8743-f14e72b07ac1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:07.219004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9adb7-69d2-4dbf-8743-f14e72b07ac1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:07.224117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea53520-2b8a-4e03-82ed-06d7130a9784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:07.224699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea53520-2b8a-4e03-82ed-06d7130a9784 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:07.224984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea53520-2b8a-4e03-82ed-06d7130a9784 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:07.225268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea53520-2b8a-4e03-82ed-06d7130a9784 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:07.226012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea53520-2b8a-4e03-82ed-06d7130a9784 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:07.226312 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea53520-2b8a-4e03-82ed-06d7130a9784 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:07.252857 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea53520-2b8a-4e03-82ed-06d7130a9784 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:07.266764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 478/957] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:07.273072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217e6f9-5f38-4ac8-adba-ebd064bbb9b6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:07.282780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217e6f9-5f38-4ac8-adba-ebd064bbb9b6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:07.286942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85920ce6-4b3e-4156-bbd5-d271b208f2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:07.287554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85920ce6-4b3e-4156-bbd5-d271b208f2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:07.287847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85920ce6-4b3e-4156-bbd5-d271b208f2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:07.288131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85920ce6-4b3e-4156-bbd5-d271b208f2c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:07.288901 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85920ce6-4b3e-4156-bbd5-d271b208f2c9 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=e99d0fbbc86b4a629b9fffb4d9565216) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:07.289205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85920ce6-4b3e-4156-bbd5-d271b208f2c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:07.316499 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85920ce6-4b3e-4156-bbd5-d271b208f2c9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:07.322355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 480/958] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:42:07 2022] GET /identity/v3/role_assignments?user.id=e99d0fbbc86b4a629b9fffb4d9565216&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:09.330442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71956fd-a721-4e23-b9f1-113f10278a0f None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:09.330968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71956fd-a721-4e23-b9f1-113f10278a0f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:09.331060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71956fd-a721-4e23-b9f1-113f10278a0f None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:09.332756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 479/959] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:09.339040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5ece-3435-4ac1-a89c-06c8c5d996fc None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:09.341036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5ece-3435-4ac1-a89c-06c8c5d996fc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:09.341036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc5ece-3435-4ac1-a89c-06c8c5d996fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:09.371152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5dcc5ece-3435-4ac1-a89c-06c8c5d996fc None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:09.372854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5dcc5ece-3435-4ac1-a89c-06c8c5d996fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:09.383067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 481/960] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:09.404415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71956fd-a721-4e23-b9f1-113f10278a0f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:09.417112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71956fd-a721-4e23-b9f1-113f10278a0f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:09.421107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780fbd-4f3d-4395-ae7e-5a50e218a619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:09.421821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780fbd-4f3d-4395-ae7e-5a50e218a619 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:09.422107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780fbd-4f3d-4395-ae7e-5a50e218a619 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:09.422997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de780fbd-4f3d-4395-ae7e-5a50e218a619 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:09.423661 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de780fbd-4f3d-4395-ae7e-5a50e218a619 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:09.449050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de780fbd-4f3d-4395-ae7e-5a50e218a619 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:09.459985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-de780fbd-4f3d-4395-ae7e-5a50e218a619 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 18 12:42:09.461053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 480/961] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:42:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:42:09.467044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc5ece-3435-4ac1-a89c-06c8c5d996fc None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:09.476821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc5ece-3435-4ac1-a89c-06c8c5d996fc None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:09.481011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb04c3d-68c3-4b3b-9650-d9e2ff5e0e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:09.481599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb04c3d-68c3-4b3b-9650-d9e2ff5e0e56 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:09.481891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb04c3d-68c3-4b3b-9650-d9e2ff5e0e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:09.482173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb04c3d-68c3-4b3b-9650-d9e2ff5e0e56 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:09.482840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb04c3d-68c3-4b3b-9650-d9e2ff5e0e56 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:09.483148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb04c3d-68c3-4b3b-9650-d9e2ff5e0e56 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:09.513339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb04c3d-68c3-4b3b-9650-d9e2ff5e0e56 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:09.519294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 482/962] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:09.525507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780fbd-4f3d-4395-ae7e-5a50e218a619 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:09.536703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de780fbd-4f3d-4395-ae7e-5a50e218a619 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:09.541729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f470b-8d40-434b-b188-071a8358ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:09.542396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f470b-8d40-434b-b188-071a8358ded5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:09.542703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f470b-8d40-434b-b188-071a8358ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:09.543007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f470b-8d40-434b-b188-071a8358ded5 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:09.543821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f470b-8d40-434b-b188-071a8358ded5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:09.544152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f470b-8d40-434b-b188-071a8358ded5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:09.570982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f470b-8d40-434b-b188-071a8358ded5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:09.575427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 481/963] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:11.648706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e39174-f38d-4f34-b36a-af31018c6ef2 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:11.649235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e39174-f38d-4f34-b36a-af31018c6ef2 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:11.649342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e39174-f38d-4f34-b36a-af31018c6ef2 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:11.650959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 483/964] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:11.656113 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1707a-d582-49a6-a841-cd7731d52685 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:11.656515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1707a-d582-49a6-a841-cd7731d52685 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:11.656678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1707a-d582-49a6-a841-cd7731d52685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:11.680154 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c7d1707a-d582-49a6-a841-cd7731d52685 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:11.681290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c7d1707a-d582-49a6-a841-cd7731d52685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:11.689063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 482/965] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:11.713357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e39174-f38d-4f34-b36a-af31018c6ef2 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:11.726966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e39174-f38d-4f34-b36a-af31018c6ef2 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:11.731464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ce7d9-045b-43d0-ab71-f5df3009741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:11.732197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce7d9-045b-43d0-ab71-f5df3009741c admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:11.732587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce7d9-045b-43d0-ab71-f5df3009741c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:11.732919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ce7d9-045b-43d0-ab71-f5df3009741c admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:11.733793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ce7d9-045b-43d0-ab71-f5df3009741c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:11.764900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ce7d9-045b-43d0-ab71-f5df3009741c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:11.880896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 484/966] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:42:11 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:42:14.012975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548d291-3f9b-49e1-9af4-8960b6ac6e78 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:14.013614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548d291-3f9b-49e1-9af4-8960b6ac6e78 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:14.013614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548d291-3f9b-49e1-9af4-8960b6ac6e78 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:14.015218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 483/967] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:14.021392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89cabd-c4ee-4596-b6b7-c68f5a7ee680 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:14.021818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89cabd-c4ee-4596-b6b7-c68f5a7ee680 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:14.022070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89cabd-c4ee-4596-b6b7-c68f5a7ee680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:14.046154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-cf89cabd-c4ee-4596-b6b7-c68f5a7ee680 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:14.047357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cf89cabd-c4ee-4596-b6b7-c68f5a7ee680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:14.065313 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 485/968] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:14 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:14.087415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548d291-3f9b-49e1-9af4-8960b6ac6e78 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:14.099836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548d291-3f9b-49e1-9af4-8960b6ac6e78 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:14.105406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368bf66-b066-44aa-8559-3fdacbad3e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:14.106150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368bf66-b066-44aa-8559-3fdacbad3e21 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:14.106436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368bf66-b066-44aa-8559-3fdacbad3e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:14.106720 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368bf66-b066-44aa-8559-3fdacbad3e21 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:14.107379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368bf66-b066-44aa-8559-3fdacbad3e21 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:14.134251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368bf66-b066-44aa-8559-3fdacbad3e21 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:14.145915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-e368bf66-b066-44aa-8559-3fdacbad3e21 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 18 12:42:14.147064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 484/969] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:42:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:14.153178 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89cabd-c4ee-4596-b6b7-c68f5a7ee680 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:14.162490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89cabd-c4ee-4596-b6b7-c68f5a7ee680 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:14.166914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b391e5-2a8a-4499-b3f0-6c6f4c465810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:14.167535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b391e5-2a8a-4499-b3f0-6c6f4c465810 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:14.167826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b391e5-2a8a-4499-b3f0-6c6f4c465810 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:14.168107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b391e5-2a8a-4499-b3f0-6c6f4c465810 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:14.168772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b391e5-2a8a-4499-b3f0-6c6f4c465810 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:14.169071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b391e5-2a8a-4499-b3f0-6c6f4c465810 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:14.195213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b391e5-2a8a-4499-b3f0-6c6f4c465810 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:14.200571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 486/970] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:14.206961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368bf66-b066-44aa-8559-3fdacbad3e21 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:14.216434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368bf66-b066-44aa-8559-3fdacbad3e21 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:14.221231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b810b12-10cd-4ebe-88f3-acbc4ecba9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:14.221829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b810b12-10cd-4ebe-88f3-acbc4ecba9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:14.222147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b810b12-10cd-4ebe-88f3-acbc4ecba9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:14.222433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b810b12-10cd-4ebe-88f3-acbc4ecba9b4 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:14.223107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b810b12-10cd-4ebe-88f3-acbc4ecba9b4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:14.223449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b810b12-10cd-4ebe-88f3-acbc4ecba9b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:14.249362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b810b12-10cd-4ebe-88f3-acbc4ecba9b4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:14.254766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 485/971] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:14.260655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b391e5-2a8a-4499-b3f0-6c6f4c465810 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:14.270749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b391e5-2a8a-4499-b3f0-6c6f4c465810 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:14.274856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e5043-f451-4c71-963e-4bca216ea46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:14.275509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5043-f451-4c71-963e-4bca216ea46f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:14.275808 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5043-f451-4c71-963e-4bca216ea46f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:14.276086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5043-f451-4c71-963e-4bca216ea46f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:14.276831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e5043-f451-4c71-963e-4bca216ea46f admin admin] RBAC: Adding query filter params (interface=public, service_id=74848f81be2544ef8c3ab39a0267f35d, region_id=RegionOne) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:14.277136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e5043-f451-4c71-963e-4bca216ea46f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:14.303621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e5043-f451-4c71-963e-4bca216ea46f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:14.309288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 487/972] 10.222.0.87 () {56 vars in 1272 bytes} [Tue Jan 18 12:42:14 2022] GET /identity/v3/endpoints?service_id=74848f81be2544ef8c3ab39a0267f35d&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:14.315480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b810b12-10cd-4ebe-88f3-acbc4ecba9b4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:14.326545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b810b12-10cd-4ebe-88f3-acbc4ecba9b4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:14.332248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c61e00-8a81-4fd5-8fae-527cf73d6f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:14.333001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c61e00-8a81-4fd5-8fae-527cf73d6f07 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:14.333348 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c61e00-8a81-4fd5-8fae-527cf73d6f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:14.333635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c61e00-8a81-4fd5-8fae-527cf73d6f07 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:14.334282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c61e00-8a81-4fd5-8fae-527cf73d6f07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:14.366532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c61e00-8a81-4fd5-8fae-527cf73d6f07 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:14.375248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 486/973] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:42:14 2022] GET /identity/v3/services => generated 2196 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 12:42:16.441231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd5fdd-1cb1-4890-90cc-28d21a53a29a None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:16.441754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd5fdd-1cb1-4890-90cc-28d21a53a29a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:16.441754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd5fdd-1cb1-4890-90cc-28d21a53a29a None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:16.443490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 488/974] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:16.448741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa05f-04dc-49d9-8df7-6a7cd8d4e4c0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:16.449186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa05f-04dc-49d9-8df7-6a7cd8d4e4c0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:16.449438 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fa05f-04dc-49d9-8df7-6a7cd8d4e4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:16.474450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c68fa05f-04dc-49d9-8df7-6a7cd8d4e4c0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:16.475760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c68fa05f-04dc-49d9-8df7-6a7cd8d4e4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:16.487816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 487/975] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:16 2022] POST /identity/v3/auth/tokens => generated 3075 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:16.518737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd5fdd-1cb1-4890-90cc-28d21a53a29a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:16.535462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd5fdd-1cb1-4890-90cc-28d21a53a29a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:16.539911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406ccd8-0584-4810-85b9-2c8c0bd4f7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:16.540979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406ccd8-0584-4810-85b9-2c8c0bd4f7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:16.541298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406ccd8-0584-4810-85b9-2c8c0bd4f7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:16.541609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d406ccd8-0584-4810-85b9-2c8c0bd4f7c5 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:16.542285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406ccd8-0584-4810-85b9-2c8c0bd4f7c5 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:16.571958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d406ccd8-0584-4810-85b9-2c8c0bd4f7c5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:16.584561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-d406ccd8-0584-4810-85b9-2c8c0bd4f7c5 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 18 12:42:16.585823 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 489/976] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:42:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:16.592312 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa05f-04dc-49d9-8df7-6a7cd8d4e4c0 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:16.601617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fa05f-04dc-49d9-8df7-6a7cd8d4e4c0 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:16.606071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdfb86-12de-408d-be3a-495662b82602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:16.606692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdfb86-12de-408d-be3a-495662b82602 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:16.606985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdfb86-12de-408d-be3a-495662b82602 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:16.607269 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdfb86-12de-408d-be3a-495662b82602 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:16.607999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdfb86-12de-408d-be3a-495662b82602 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:16.608305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdfb86-12de-408d-be3a-495662b82602 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:16.635283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdfb86-12de-408d-be3a-495662b82602 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:16.641001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 488/977] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:16.647255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406ccd8-0584-4810-85b9-2c8c0bd4f7c5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:16.657060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d406ccd8-0584-4810-85b9-2c8c0bd4f7c5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:16.661367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffd763-076d-4bb1-93fe-5301751df742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:16.662072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffd763-076d-4bb1-93fe-5301751df742 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:16.662429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffd763-076d-4bb1-93fe-5301751df742 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:16.662757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffd763-076d-4bb1-93fe-5301751df742 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:16.663645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffd763-076d-4bb1-93fe-5301751df742 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:16.664026 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffd763-076d-4bb1-93fe-5301751df742 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:16.694618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffd763-076d-4bb1-93fe-5301751df742 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:16.700878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 490/978] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:16.707052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdfb86-12de-408d-be3a-495662b82602 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:16.716759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdfb86-12de-408d-be3a-495662b82602 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:16.721752 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bf0ce-e590-41a6-91fa-daeb70d47cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:16.722357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bf0ce-e590-41a6-91fa-daeb70d47cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:16.722649 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bf0ce-e590-41a6-91fa-daeb70d47cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:16.722936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bf0ce-e590-41a6-91fa-daeb70d47cf0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:16.723699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bf0ce-e590-41a6-91fa-daeb70d47cf0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:16.750476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58bf0ce-e590-41a6-91fa-daeb70d47cf0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:16.842049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 489/979] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:42:16 2022] POST /identity/v3/endpoints => generated 349 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:42:19.082444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ce2e-4cf1-4adc-b66c-6e7356a3cc13 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:19.082981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ce2e-4cf1-4adc-b66c-6e7356a3cc13 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:19.082981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189ce2e-4cf1-4adc-b66c-6e7356a3cc13 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:19.084704 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 491/980] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:19.090458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d2e0-35b5-4dd7-8013-ac0830ce4bd8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:19.090907 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d2e0-35b5-4dd7-8013-ac0830ce4bd8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:19.091268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55d2e0-35b5-4dd7-8013-ac0830ce4bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:19.118167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-6a55d2e0-35b5-4dd7-8013-ac0830ce4bd8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:19.119599 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6a55d2e0-35b5-4dd7-8013-ac0830ce4bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:19.139188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 490/981] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:19.162002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ce2e-4cf1-4adc-b66c-6e7356a3cc13 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:19.173779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189ce2e-4cf1-4adc-b66c-6e7356a3cc13 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:19.177685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1271-f6d5-46a2-9209-24cb42ea3c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:19.178401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1271-f6d5-46a2-9209-24cb42ea3c08 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:19.178688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1271-f6d5-46a2-9209-24cb42ea3c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:19.178995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b1271-f6d5-46a2-9209-24cb42ea3c08 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:19.179641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b1271-f6d5-46a2-9209-24cb42ea3c08 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:19.206013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b1271-f6d5-46a2-9209-24cb42ea3c08 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:19.216718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-4c8b1271-f6d5-46a2-9209-24cb42ea3c08 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 18 12:42:19.217786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 492/982] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:42:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:19.224663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55d2e0-35b5-4dd7-8013-ac0830ce4bd8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:19.233300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55d2e0-35b5-4dd7-8013-ac0830ce4bd8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:19.237956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db89185-76e1-4b1e-9137-ae1b54b21037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:19.238607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db89185-76e1-4b1e-9137-ae1b54b21037 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:19.238895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db89185-76e1-4b1e-9137-ae1b54b21037 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:19.239177 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db89185-76e1-4b1e-9137-ae1b54b21037 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:19.239894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db89185-76e1-4b1e-9137-ae1b54b21037 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:19.240196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db89185-76e1-4b1e-9137-ae1b54b21037 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:19.266163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db89185-76e1-4b1e-9137-ae1b54b21037 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:19.272659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 491/983] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:19.278507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1271-f6d5-46a2-9209-24cb42ea3c08 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:19.288817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b1271-f6d5-46a2-9209-24cb42ea3c08 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:19.293145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff1f0-aa7a-46e4-8f10-65ecd052ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:19.293716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff1f0-aa7a-46e4-8f10-65ecd052ba38 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:19.294003 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff1f0-aa7a-46e4-8f10-65ecd052ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:19.294276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ff1f0-aa7a-46e4-8f10-65ecd052ba38 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:19.294932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ff1f0-aa7a-46e4-8f10-65ecd052ba38 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:19.295228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ff1f0-aa7a-46e4-8f10-65ecd052ba38 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:19.320941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ff1f0-aa7a-46e4-8f10-65ecd052ba38 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:19.325922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 493/984] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:19.333116 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db89185-76e1-4b1e-9137-ae1b54b21037 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:19.342376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db89185-76e1-4b1e-9137-ae1b54b21037 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:19.347084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5e06e-3600-4f8a-86ac-479cb0fbf22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:19.347709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5e06e-3600-4f8a-86ac-479cb0fbf22d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:19.348000 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5e06e-3600-4f8a-86ac-479cb0fbf22d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:19.348284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5e06e-3600-4f8a-86ac-479cb0fbf22d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:19.349031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5e06e-3600-4f8a-86ac-479cb0fbf22d admin admin] RBAC: Adding query filter params (interface=admin, service_id=74848f81be2544ef8c3ab39a0267f35d, region_id=RegionOne) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:19.349337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5e06e-3600-4f8a-86ac-479cb0fbf22d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:19.374860 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5e06e-3600-4f8a-86ac-479cb0fbf22d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:19.381491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 492/985] 10.222.0.87 () {56 vars in 1270 bytes} [Tue Jan 18 12:42:19 2022] GET /identity/v3/endpoints?service_id=74848f81be2544ef8c3ab39a0267f35d&interface=admin®ion_id=RegionOne => generated 193 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:19.387214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff1f0-aa7a-46e4-8f10-65ecd052ba38 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:19.397267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ff1f0-aa7a-46e4-8f10-65ecd052ba38 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:19.401497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330058a4-c035-43d3-83fe-f08cc5a513a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:19.402099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330058a4-c035-43d3-83fe-f08cc5a513a2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:19.402390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330058a4-c035-43d3-83fe-f08cc5a513a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:19.402673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330058a4-c035-43d3-83fe-f08cc5a513a2 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:19.403382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330058a4-c035-43d3-83fe-f08cc5a513a2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:19.429307 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330058a4-c035-43d3-83fe-f08cc5a513a2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:19.437038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 494/986] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:42:19 2022] GET /identity/v3/services => generated 2196 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 12:42:21.444856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6746e-3368-435e-a5ee-2ca480975ace None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:21.445375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6746e-3368-435e-a5ee-2ca480975ace None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:21.445375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6746e-3368-435e-a5ee-2ca480975ace None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:21.446993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 493/987] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:21.452465 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af0d67-c19a-4769-b5a0-bce48efb0425 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:21.452930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af0d67-c19a-4769-b5a0-bce48efb0425 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:21.453019 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af0d67-c19a-4769-b5a0-bce48efb0425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:21.476045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-59af0d67-c19a-4769-b5a0-bce48efb0425 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:21.477195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-59af0d67-c19a-4769-b5a0-bce48efb0425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:21.484177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 495/988] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:21.507919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6746e-3368-435e-a5ee-2ca480975ace None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:21.520855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6746e-3368-435e-a5ee-2ca480975ace None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:21.524785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13537b78-09e6-4cff-b6db-d80d5da4fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:21.525521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537b78-09e6-4cff-b6db-d80d5da4fbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:21.525806 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537b78-09e6-4cff-b6db-d80d5da4fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:21.526087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13537b78-09e6-4cff-b6db-d80d5da4fbc1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:21.526709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13537b78-09e6-4cff-b6db-d80d5da4fbc1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:21.555268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13537b78-09e6-4cff-b6db-d80d5da4fbc1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:21.566764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-13537b78-09e6-4cff-b6db-d80d5da4fbc1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 18 12:42:21.567923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 494/989] 10.222.0.87 () {56 vars in 1147 bytes} [Tue Jan 18 12:42:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:21.574163 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af0d67-c19a-4769-b5a0-bce48efb0425 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:21.586419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af0d67-c19a-4769-b5a0-bce48efb0425 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:21.590537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e177c-2445-4b5a-824e-c6db03e2616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:21.591128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e177c-2445-4b5a-824e-c6db03e2616c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:21.591447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e177c-2445-4b5a-824e-c6db03e2616c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:21.591725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e177c-2445-4b5a-824e-c6db03e2616c admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:21.592387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e177c-2445-4b5a-824e-c6db03e2616c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:21.592688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e177c-2445-4b5a-824e-c6db03e2616c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:21.619106 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e177c-2445-4b5a-824e-c6db03e2616c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:21.624622 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 496/990] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:21.631181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13537b78-09e6-4cff-b6db-d80d5da4fbc1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:21.640677 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13537b78-09e6-4cff-b6db-d80d5da4fbc1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:21.645744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2a8ab-0aef-45f6-a0a3-7d3187850a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:21.646334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2a8ab-0aef-45f6-a0a3-7d3187850a7b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:21.646617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2a8ab-0aef-45f6-a0a3-7d3187850a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:21.646893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2a8ab-0aef-45f6-a0a3-7d3187850a7b admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:21.647719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2a8ab-0aef-45f6-a0a3-7d3187850a7b admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:21.648015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2a8ab-0aef-45f6-a0a3-7d3187850a7b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:21.674745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2a8ab-0aef-45f6-a0a3-7d3187850a7b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:21.680216 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 495/991] 10.222.0.87 () {56 vars in 1143 bytes} [Tue Jan 18 12:42:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:21.688104 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e177c-2445-4b5a-824e-c6db03e2616c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:21.702172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e177c-2445-4b5a-824e-c6db03e2616c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:21.707902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc62bd1-4177-47a0-951e-6a6d3e611a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:21.708493 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62bd1-4177-47a0-951e-6a6d3e611a7e admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:21.708783 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62bd1-4177-47a0-951e-6a6d3e611a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:21.709065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc62bd1-4177-47a0-951e-6a6d3e611a7e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:21.709768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc62bd1-4177-47a0-951e-6a6d3e611a7e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:21.735457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc62bd1-4177-47a0-951e-6a6d3e611a7e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:21.846123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 497/992] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:42:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:42:23.868114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840418cf-15bb-40f3-a859-559b48adf2da None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:23.868691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840418cf-15bb-40f3-a859-559b48adf2da None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:23.868691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840418cf-15bb-40f3-a859-559b48adf2da None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:23.870368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 496/993] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:23.876323 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fcaa9-1423-41a7-8eb1-64444caae23e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:23.876826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fcaa9-1423-41a7-8eb1-64444caae23e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:23.876919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48fcaa9-1423-41a7-8eb1-64444caae23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:23.899968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d48fcaa9-1423-41a7-8eb1-64444caae23e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:23.901097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d48fcaa9-1423-41a7-8eb1-64444caae23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:23.919134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 498/994] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:23 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:23.943136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840418cf-15bb-40f3-a859-559b48adf2da None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:23.955136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840418cf-15bb-40f3-a859-559b48adf2da None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:23.959088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7ac97-242d-4287-93c6-87a3eb78bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:23.959843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ac97-242d-4287-93c6-87a3eb78bbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:23.960130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ac97-242d-4287-93c6-87a3eb78bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:23.960411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7ac97-242d-4287-93c6-87a3eb78bbd2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:23.961496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7ac97-242d-4287-93c6-87a3eb78bbd2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:23.988314 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7ac97-242d-4287-93c6-87a3eb78bbd2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:23.989856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 497/995] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:23.995902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fcaa9-1423-41a7-8eb1-64444caae23e None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:24.004835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48fcaa9-1423-41a7-8eb1-64444caae23e None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:24.009015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82985ca0-d817-497a-a072-e2614c375d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:24.009602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82985ca0-d817-497a-a072-e2614c375d09 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:24.009893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82985ca0-d817-497a-a072-e2614c375d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:24.010177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82985ca0-d817-497a-a072-e2614c375d09 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:24.010824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82985ca0-d817-497a-a072-e2614c375d09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:24.038168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82985ca0-d817-497a-a072-e2614c375d09 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:24.148308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 499/996] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:42:23 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:42:26.283169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825669-3c3a-4a77-b161-a79d93348adb None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:26.283711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825669-3c3a-4a77-b161-a79d93348adb None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:26.283802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59825669-3c3a-4a77-b161-a79d93348adb None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:26.285431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 498/997] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 12:42:26.292359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55087cdb-5583-4dd0-b17a-e35383f122cd None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:26.292879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55087cdb-5583-4dd0-b17a-e35383f122cd None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:26.292992 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55087cdb-5583-4dd0-b17a-e35383f122cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:26.316716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-55087cdb-5583-4dd0-b17a-e35383f122cd None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:26.317888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-55087cdb-5583-4dd0-b17a-e35383f122cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:26.384514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 500/998] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:26 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:26.409303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825669-3c3a-4a77-b161-a79d93348adb None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:26.421440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59825669-3c3a-4a77-b161-a79d93348adb None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:26.426692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a95c8-20a9-4570-bc84-360e6d6dff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:26.427453 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a95c8-20a9-4570-bc84-360e6d6dff46 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:26.427746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a95c8-20a9-4570-bc84-360e6d6dff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:26.428026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a95c8-20a9-4570-bc84-360e6d6dff46 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:26.429118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a95c8-20a9-4570-bc84-360e6d6dff46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:26.456391 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a95c8-20a9-4570-bc84-360e6d6dff46 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:26.458035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 499/999] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:26.463901 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55087cdb-5583-4dd0-b17a-e35383f122cd None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:26.474228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55087cdb-5583-4dd0-b17a-e35383f122cd None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:26.478433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f41ea-c09f-42cc-ab8e-380f9f99ad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:26.479029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f41ea-c09f-42cc-ab8e-380f9f99ad29 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:26.479333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f41ea-c09f-42cc-ab8e-380f9f99ad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:26.479625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f41ea-c09f-42cc-ab8e-380f9f99ad29 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:26.480290 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f41ea-c09f-42cc-ab8e-380f9f99ad29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:26.507038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f41ea-c09f-42cc-ab8e-380f9f99ad29 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:26.656451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 501/1000] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:42:26 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:42:28.691843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da52f-a049-44be-b6f1-713c2ac7879e None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:28.692440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da52f-a049-44be-b6f1-713c2ac7879e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:28.692440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005da52f-a049-44be-b6f1-713c2ac7879e None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:28.694104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 500/1001] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:28.700051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c14eff-4a02-4771-80c8-fdd181742b14 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:28.700835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c14eff-4a02-4771-80c8-fdd181742b14 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:28.701023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c14eff-4a02-4771-80c8-fdd181742b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:28.725338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-72c14eff-4a02-4771-80c8-fdd181742b14 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:28.726491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-72c14eff-4a02-4771-80c8-fdd181742b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:28.733496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 502/1002] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:28 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:42:28.756275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da52f-a049-44be-b6f1-713c2ac7879e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:28.769041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005da52f-a049-44be-b6f1-713c2ac7879e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:28.773319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109a67c-db43-472a-9176-a5c063a3116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:28.774050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109a67c-db43-472a-9176-a5c063a3116a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:28.774334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109a67c-db43-472a-9176-a5c063a3116a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:28.774612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109a67c-db43-472a-9176-a5c063a3116a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:28.788071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109a67c-db43-472a-9176-a5c063a3116a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:42:28.794585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-8109a67c-db43-472a-9176-a5c063a3116a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:42:28.795722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 501/1003] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:28.801884 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c14eff-4a02-4771-80c8-fdd181742b14 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:28.810816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c14eff-4a02-4771-80c8-fdd181742b14 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:28.815449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e620f3-9bfb-49bc-992b-5d460685e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:28.816063 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e620f3-9bfb-49bc-992b-5d460685e685 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:28.816352 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e620f3-9bfb-49bc-992b-5d460685e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:28.816635 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e620f3-9bfb-49bc-992b-5d460685e685 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:28.817356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e620f3-9bfb-49bc-992b-5d460685e685 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:28.817657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e620f3-9bfb-49bc-992b-5d460685e685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:28.843781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e620f3-9bfb-49bc-992b-5d460685e685 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:28.853444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 503/1004] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:28.859281 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109a67c-db43-472a-9176-a5c063a3116a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:28.868872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109a67c-db43-472a-9176-a5c063a3116a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:28.873071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee9bb8-ced7-4c58-bb64-1b9e7bfd2c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:28.873874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee9bb8-ced7-4c58-bb64-1b9e7bfd2c37 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:28.874157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee9bb8-ced7-4c58-bb64-1b9e7bfd2c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:28.874436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee9bb8-ced7-4c58-bb64-1b9e7bfd2c37 admin admin] PATH_INFO: `/v3/users/d8757db797bc42fdb47482ccc81f7f7a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:28.894588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee9bb8-ced7-4c58-bb64-1b9e7bfd2c37 admin admin] RBAC: Authorizing `identity:get_user(user_id=d8757db797bc42fdb47482ccc81f7f7a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:28.920722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee9bb8-ced7-4c58-bb64-1b9e7bfd2c37 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:28.922310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 502/1005] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:28 2022] GET /identity/v3/users/d8757db797bc42fdb47482ccc81f7f7a => generated 285 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:28.928551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e620f3-9bfb-49bc-992b-5d460685e685 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:28.939485 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e620f3-9bfb-49bc-992b-5d460685e685 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:28.944175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9585-8427-45c0-9a13-afd66325472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:28.944707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9585-8427-45c0-9a13-afd66325472b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:28.945000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9585-8427-45c0-9a13-afd66325472b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:28.945285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff9585-8427-45c0-9a13-afd66325472b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:28.953584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9585-8427-45c0-9a13-afd66325472b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:28.979751 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff9585-8427-45c0-9a13-afd66325472b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:28.989056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 504/1006] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:42:28 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:42:28.995023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee9bb8-ced7-4c58-bb64-1b9e7bfd2c37 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:29.004839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee9bb8-ced7-4c58-bb64-1b9e7bfd2c37 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:29.008964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cccc9-1e64-426c-92d3-d887d10b3649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:29.009738 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cccc9-1e64-426c-92d3-d887d10b3649 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:29.010024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cccc9-1e64-426c-92d3-d887d10b3649 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:29.010304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cccc9-1e64-426c-92d3-d887d10b3649 admin admin] PATH_INFO: `/v3/projects/15f72aeccb644494a5efc48bc0da913d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:29.011415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cccc9-1e64-426c-92d3-d887d10b3649 admin admin] RBAC: Authorizing `identity:get_project(project_id=15f72aeccb644494a5efc48bc0da913d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:29.037756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cccc9-1e64-426c-92d3-d887d10b3649 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:29.039415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 503/1007] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:42:28 2022] GET /identity/v3/projects/15f72aeccb644494a5efc48bc0da913d => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:29.045992 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9585-8427-45c0-9a13-afd66325472b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:29.055031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff9585-8427-45c0-9a13-afd66325472b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:29.059580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d714077-f9c7-4a28-8aae-b2882813d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:29.060424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714077-f9c7-4a28-8aae-b2882813d47e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:29.060724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714077-f9c7-4a28-8aae-b2882813d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:29.061009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d714077-f9c7-4a28-8aae-b2882813d47e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:29.061805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d714077-f9c7-4a28-8aae-b2882813d47e admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=15f72aeccb644494a5efc48bc0da913d, user.id=d8757db797bc42fdb47482ccc81f7f7a) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:29.062110 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d714077-f9c7-4a28-8aae-b2882813d47e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:29.089210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d714077-f9c7-4a28-8aae-b2882813d47e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:29.095228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 505/1008] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:42:29 2022] GET /identity/v3/role_assignments?user.id=d8757db797bc42fdb47482ccc81f7f7a&scope.project.id=15f72aeccb644494a5efc48bc0da913d&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:31.158088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795e70-b614-4987-901b-63cd8daf0258 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:31.159038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795e70-b614-4987-901b-63cd8daf0258 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:31.159038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8795e70-b614-4987-901b-63cd8daf0258 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:31.160435 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 504/1009] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:31.165754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955bbfd-4b47-4d1c-b886-159432c14504 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:31.166136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955bbfd-4b47-4d1c-b886-159432c14504 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:31.166581 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955bbfd-4b47-4d1c-b886-159432c14504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:31.188415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-4955bbfd-4b47-4d1c-b886-159432c14504 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:31.190272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-4955bbfd-4b47-4d1c-b886-159432c14504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:31.197208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 506/1010] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:31 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:31.220018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795e70-b614-4987-901b-63cd8daf0258 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:31.231715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8795e70-b614-4987-901b-63cd8daf0258 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:31.235636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac742036-92dc-425b-8d81-033802f63bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:31.236854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac742036-92dc-425b-8d81-033802f63bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:31.237140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac742036-92dc-425b-8d81-033802f63bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:31.237422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac742036-92dc-425b-8d81-033802f63bd7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:31.248559 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac742036-92dc-425b-8d81-033802f63bd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:42:31.255683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-ac742036-92dc-425b-8d81-033802f63bd7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:42:31.256801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 505/1011] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:31.262913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955bbfd-4b47-4d1c-b886-159432c14504 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:31.272350 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955bbfd-4b47-4d1c-b886-159432c14504 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:31.276553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8464a-b00e-439b-9ace-b37a35c7fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:31.277140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8464a-b00e-439b-9ace-b37a35c7fa38 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:31.277424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8464a-b00e-439b-9ace-b37a35c7fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:31.277701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8464a-b00e-439b-9ace-b37a35c7fa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:31.278398 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8464a-b00e-439b-9ace-b37a35c7fa38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:31.278701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8464a-b00e-439b-9ace-b37a35c7fa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:31.304606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8464a-b00e-439b-9ace-b37a35c7fa38 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:31.313604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 507/1012] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:31.320262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac742036-92dc-425b-8d81-033802f63bd7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:31.332615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac742036-92dc-425b-8d81-033802f63bd7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:31.336789 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaa2ad-69da-4450-8d0c-40d62cf83d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:31.337604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaa2ad-69da-4450-8d0c-40d62cf83d21 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:31.337893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaa2ad-69da-4450-8d0c-40d62cf83d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:31.338174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaa2ad-69da-4450-8d0c-40d62cf83d21 admin admin] PATH_INFO: `/v3/users/d8757db797bc42fdb47482ccc81f7f7a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:31.339260 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaa2ad-69da-4450-8d0c-40d62cf83d21 admin admin] RBAC: Authorizing `identity:get_user(user_id=d8757db797bc42fdb47482ccc81f7f7a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:31.365275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaa2ad-69da-4450-8d0c-40d62cf83d21 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:31.366999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 506/1013] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:31 2022] GET /identity/v3/users/d8757db797bc42fdb47482ccc81f7f7a => generated 285 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:31.372870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8464a-b00e-439b-9ace-b37a35c7fa38 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:31.383064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8464a-b00e-439b-9ace-b37a35c7fa38 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:31.387188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e3181-7406-4841-a05a-e506ab67d3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:31.388003 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e3181-7406-4841-a05a-e506ab67d3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:31.388289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e3181-7406-4841-a05a-e506ab67d3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:31.388564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e3181-7406-4841-a05a-e506ab67d3d5 admin admin] PATH_INFO: `/v3/projects/15f72aeccb644494a5efc48bc0da913d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:31.389638 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e3181-7406-4841-a05a-e506ab67d3d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=15f72aeccb644494a5efc48bc0da913d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:31.417746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e3181-7406-4841-a05a-e506ab67d3d5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:31.419421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 508/1014] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:42:31 2022] GET /identity/v3/projects/15f72aeccb644494a5efc48bc0da913d => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:31.425429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaa2ad-69da-4450-8d0c-40d62cf83d21 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:31.435105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaa2ad-69da-4450-8d0c-40d62cf83d21 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:31.439967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e617d-cdb5-418e-bcbd-89783112d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:31.440899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e617d-cdb5-418e-bcbd-89783112d8be admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:31.441187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e617d-cdb5-418e-bcbd-89783112d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:31.441467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e617d-cdb5-418e-bcbd-89783112d8be admin admin] PATH_INFO: `/v3/projects/15f72aeccb644494a5efc48bc0da913d/users/d8757db797bc42fdb47482ccc81f7f7a/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:31.443703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e617d-cdb5-418e-bcbd-89783112d8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f72aeccb644494a5efc48bc0da913d, user_id=d8757db797bc42fdb47482ccc81f7f7a, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:31.470587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e617d-cdb5-418e-bcbd-89783112d8be admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:31.579188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 507/1015] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:42:31 2022] PUT /identity/v3/projects/15f72aeccb644494a5efc48bc0da913d/users/d8757db797bc42fdb47482ccc81f7f7a/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:42:33.602623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c207356-c8ce-4e93-bb7e-42b2cbe75fa4 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:33.603176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c207356-c8ce-4e93-bb7e-42b2cbe75fa4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:33.603176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c207356-c8ce-4e93-bb7e-42b2cbe75fa4 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:33.604878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 509/1016] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:33.609983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0279bab-f4b9-4939-927c-0e42738d69bb None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:33.610365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0279bab-f4b9-4939-927c-0e42738d69bb None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:33.610551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0279bab-f4b9-4939-927c-0e42738d69bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:33.633011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b0279bab-f4b9-4939-927c-0e42738d69bb None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:33.634137 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b0279bab-f4b9-4939-927c-0e42738d69bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:33.697310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 508/1017] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:33 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:42:33.720182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c207356-c8ce-4e93-bb7e-42b2cbe75fa4 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:33.731951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c207356-c8ce-4e93-bb7e-42b2cbe75fa4 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:33.735975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01b39b-11f8-4c9f-b3ca-72f8829d1420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:33.737202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b39b-11f8-4c9f-b3ca-72f8829d1420 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:33.737488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b39b-11f8-4c9f-b3ca-72f8829d1420 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:33.737767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b39b-11f8-4c9f-b3ca-72f8829d1420 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:33.749517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01b39b-11f8-4c9f-b3ca-72f8829d1420 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:42:33.756377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-2b01b39b-11f8-4c9f-b3ca-72f8829d1420 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:42:33.757527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 510/1018] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:33.763872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0279bab-f4b9-4939-927c-0e42738d69bb None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:33.775678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0279bab-f4b9-4939-927c-0e42738d69bb None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:33.779937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9bce-a09f-4b08-9e97-81b44383ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:33.780534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9bce-a09f-4b08-9e97-81b44383ab6a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:33.780811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9bce-a09f-4b08-9e97-81b44383ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:33.781087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9bce-a09f-4b08-9e97-81b44383ab6a admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:33.781800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f9bce-a09f-4b08-9e97-81b44383ab6a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:33.782092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f9bce-a09f-4b08-9e97-81b44383ab6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:33.808234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f9bce-a09f-4b08-9e97-81b44383ab6a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:33.818586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 509/1019] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:42:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:33.824612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01b39b-11f8-4c9f-b3ca-72f8829d1420 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:33.834735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01b39b-11f8-4c9f-b3ca-72f8829d1420 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:33.838955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2b2a0-09d6-4441-ae57-f70d8f4c57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:33.839784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b2a0-09d6-4441-ae57-f70d8f4c57e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:33.840074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b2a0-09d6-4441-ae57-f70d8f4c57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:33.840354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2b2a0-09d6-4441-ae57-f70d8f4c57e7 admin admin] PATH_INFO: `/v3/users/d8757db797bc42fdb47482ccc81f7f7a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:33.841454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2b2a0-09d6-4441-ae57-f70d8f4c57e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=d8757db797bc42fdb47482ccc81f7f7a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:33.869389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2b2a0-09d6-4441-ae57-f70d8f4c57e7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:33.870946 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 511/1020] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:33 2022] GET /identity/v3/users/d8757db797bc42fdb47482ccc81f7f7a => generated 285 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:33.877477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9bce-a09f-4b08-9e97-81b44383ab6a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:33.888106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9bce-a09f-4b08-9e97-81b44383ab6a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:33.892430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1c6b2-cfc5-4fb6-9825-a97a444fba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:33.893091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1c6b2-cfc5-4fb6-9825-a97a444fba47 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:33.893353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1c6b2-cfc5-4fb6-9825-a97a444fba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:33.893636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1c6b2-cfc5-4fb6-9825-a97a444fba47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:33.901802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1c6b2-cfc5-4fb6-9825-a97a444fba47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:33.928041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1c6b2-cfc5-4fb6-9825-a97a444fba47 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:33.937368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 510/1021] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:42:33 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:42:33.944242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2b2a0-09d6-4441-ae57-f70d8f4c57e7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:33.954000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2b2a0-09d6-4441-ae57-f70d8f4c57e7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:33.958541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e198469-565f-486d-9abe-b6c096411375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:33.959343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198469-565f-486d-9abe-b6c096411375 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:33.959637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198469-565f-486d-9abe-b6c096411375 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:33.959914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e198469-565f-486d-9abe-b6c096411375 admin admin] PATH_INFO: `/v3/projects/15f72aeccb644494a5efc48bc0da913d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:33.961003 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e198469-565f-486d-9abe-b6c096411375 admin admin] RBAC: Authorizing `identity:get_project(project_id=15f72aeccb644494a5efc48bc0da913d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:33.987916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e198469-565f-486d-9abe-b6c096411375 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:33.989579 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 512/1022] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:42:33 2022] GET /identity/v3/projects/15f72aeccb644494a5efc48bc0da913d => generated 311 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:33.995767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1c6b2-cfc5-4fb6-9825-a97a444fba47 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:34.005979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1c6b2-cfc5-4fb6-9825-a97a444fba47 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:34.010203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae981-3a2c-430a-ae1a-7934526a3204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:34.010792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae981-3a2c-430a-ae1a-7934526a3204 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:34.011079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae981-3a2c-430a-ae1a-7934526a3204 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:34.011389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae981-3a2c-430a-ae1a-7934526a3204 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:34.012177 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae981-3a2c-430a-ae1a-7934526a3204 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=15f72aeccb644494a5efc48bc0da913d, user.id=d8757db797bc42fdb47482ccc81f7f7a) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:34.012484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae981-3a2c-430a-ae1a-7934526a3204 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:34.038143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae981-3a2c-430a-ae1a-7934526a3204 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:34.044851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 511/1023] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:42:33 2022] GET /identity/v3/role_assignments?user.id=d8757db797bc42fdb47482ccc81f7f7a&scope.project.id=15f72aeccb644494a5efc48bc0da913d&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:36.165776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ae5b-6c97-49d4-987b-8c988585b103 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:36.166360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ae5b-6c97-49d4-987b-8c988585b103 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:36.166360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54ae5b-6c97-49d4-987b-8c988585b103 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:36.168329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 513/1024] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:36.173514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9c02-151c-45a3-bff7-fe4bab9972b6 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:36.175909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9c02-151c-45a3-bff7-fe4bab9972b6 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:36.176204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9c02-151c-45a3-bff7-fe4bab9972b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:36.198420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c24d9c02-151c-45a3-bff7-fe4bab9972b6 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:36.199589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c24d9c02-151c-45a3-bff7-fe4bab9972b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:36.207627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 512/1025] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:36 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:36.232484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ae5b-6c97-49d4-987b-8c988585b103 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:36.245829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54ae5b-6c97-49d4-987b-8c988585b103 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:36.250241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fd600-0929-4995-9422-e6d30c357250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:36.251056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fd600-0929-4995-9422-e6d30c357250 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:36.251406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fd600-0929-4995-9422-e6d30c357250 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:36.251718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fd600-0929-4995-9422-e6d30c357250 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:36.253028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fd600-0929-4995-9422-e6d30c357250 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:36.284223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fd600-0929-4995-9422-e6d30c357250 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:36.285984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 514/1026] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:36.292048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d9c02-151c-45a3-bff7-fe4bab9972b6 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:36.301823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d9c02-151c-45a3-bff7-fe4bab9972b6 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:36.305983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771d402-cd83-4e0b-a2d6-764bb1d7424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:36.306577 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d402-cd83-4e0b-a2d6-764bb1d7424d admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:36.306867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d402-cd83-4e0b-a2d6-764bb1d7424d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:36.307151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d402-cd83-4e0b-a2d6-764bb1d7424d admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:36.307845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d402-cd83-4e0b-a2d6-764bb1d7424d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:36.334790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d402-cd83-4e0b-a2d6-764bb1d7424d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:36.428104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 513/1027] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:42:36 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:42:38.595365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff8f8-f09f-4d02-8cfc-f1960573b598 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:38.596759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff8f8-f09f-4d02-8cfc-f1960573b598 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:38.596759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ff8f8-f09f-4d02-8cfc-f1960573b598 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:38.598332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 515/1028] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:38.603592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7a3b1-4595-4d7b-ba31-82add41dd540 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:38.604006 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7a3b1-4595-4d7b-ba31-82add41dd540 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:38.604162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7a3b1-4595-4d7b-ba31-82add41dd540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:38.627733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4fb7a3b1-4595-4d7b-ba31-82add41dd540 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:38.629140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4fb7a3b1-4595-4d7b-ba31-82add41dd540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:38.636038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 514/1029] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:38 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:38.659008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff8f8-f09f-4d02-8cfc-f1960573b598 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:38.672258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ff8f8-f09f-4d02-8cfc-f1960573b598 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:38.676744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1bba5-12ec-451f-b3a2-cd90731145ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:38.677579 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1bba5-12ec-451f-b3a2-cd90731145ad admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:38.677869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1bba5-12ec-451f-b3a2-cd90731145ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:38.678166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1bba5-12ec-451f-b3a2-cd90731145ad admin admin] PATH_INFO: `/v3/roles/3876294260db4719972a530e23d90b2f` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:38.680083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1bba5-12ec-451f-b3a2-cd90731145ad admin admin] RBAC: Authorizing `identity:get_role(role_id=3876294260db4719972a530e23d90b2f)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:38.709553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-bdb1bba5-12ec-451f-b3a2-cd90731145ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:42:38.709553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:42:38.709553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:42:38.710442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1bba5-12ec-451f-b3a2-cd90731145ad admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:38.711904 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 516/1030] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:38 2022] GET /identity/v3/roles/3876294260db4719972a530e23d90b2f => generated 223 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:38.718294 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7a3b1-4595-4d7b-ba31-82add41dd540 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:38.727985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7a3b1-4595-4d7b-ba31-82add41dd540 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:38.732164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf7e7e-802d-48a0-be96-05102b4f4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:38.732969 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf7e7e-802d-48a0-be96-05102b4f4080 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:38.733257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf7e7e-802d-48a0-be96-05102b4f4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:38.733536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf7e7e-802d-48a0-be96-05102b4f4080 admin admin] PATH_INFO: `/v3/users/d363a5ec9e1246499cccc589b5e8a6bd` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:38.753010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf7e7e-802d-48a0-be96-05102b4f4080 admin admin] RBAC: Authorizing `identity:get_user(user_id=d363a5ec9e1246499cccc589b5e8a6bd)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:38.779772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf7e7e-802d-48a0-be96-05102b4f4080 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:38.781351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 515/1031] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:38 2022] GET /identity/v3/users/d363a5ec9e1246499cccc589b5e8a6bd => generated 286 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:38.787492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1bba5-12ec-451f-b3a2-cd90731145ad admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:38.797127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1bba5-12ec-451f-b3a2-cd90731145ad admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:38.801373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc1a8-d751-48f8-89b8-ee59fe86a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:38.801942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc1a8-d751-48f8-89b8-ee59fe86a201 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:38.802230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc1a8-d751-48f8-89b8-ee59fe86a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:38.802511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc1a8-d751-48f8-89b8-ee59fe86a201 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:38.810137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fc1a8-d751-48f8-89b8-ee59fe86a201 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:38.836795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fc1a8-d751-48f8-89b8-ee59fe86a201 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:38.846920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 517/1032] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:42:38 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:42:38.852415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf7e7e-802d-48a0-be96-05102b4f4080 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:38.862672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf7e7e-802d-48a0-be96-05102b4f4080 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:38.866917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9d912-d4b0-4c53-8808-8ad1845580ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:38.867731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9d912-d4b0-4c53-8808-8ad1845580ff admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:38.868025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9d912-d4b0-4c53-8808-8ad1845580ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:38.868308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9d912-d4b0-4c53-8808-8ad1845580ff admin admin] PATH_INFO: `/v3/projects/15f72aeccb644494a5efc48bc0da913d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:38.869398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9d912-d4b0-4c53-8808-8ad1845580ff admin admin] RBAC: Authorizing `identity:get_project(project_id=15f72aeccb644494a5efc48bc0da913d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:38.896356 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9d912-d4b0-4c53-8808-8ad1845580ff admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:38.898002 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 516/1033] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:42:38 2022] GET /identity/v3/projects/15f72aeccb644494a5efc48bc0da913d => generated 311 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:38.904145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc1a8-d751-48f8-89b8-ee59fe86a201 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:38.913588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc1a8-d751-48f8-89b8-ee59fe86a201 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:38.918121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1615a-2449-4878-b17f-afae92c47aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:38.918691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1615a-2449-4878-b17f-afae92c47aef admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:38.918980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1615a-2449-4878-b17f-afae92c47aef admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:38.919262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1615a-2449-4878-b17f-afae92c47aef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:38.920072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1615a-2449-4878-b17f-afae92c47aef admin admin] RBAC: Adding query filter params (role.id=3876294260db4719972a530e23d90b2f, scope.project.id=15f72aeccb644494a5efc48bc0da913d, user.id=d363a5ec9e1246499cccc589b5e8a6bd) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:38.920377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1615a-2449-4878-b17f-afae92c47aef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:38.946594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1615a-2449-4878-b17f-afae92c47aef admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:38.952564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 518/1034] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:42:38 2022] GET /identity/v3/role_assignments?user.id=d363a5ec9e1246499cccc589b5e8a6bd&scope.project.id=15f72aeccb644494a5efc48bc0da913d&role.id=3876294260db4719972a530e23d90b2f => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:40.932961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988516d-f570-4a7e-b54d-5607eb3a853b None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:40.933514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988516d-f570-4a7e-b54d-5607eb3a853b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:40.933514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988516d-f570-4a7e-b54d-5607eb3a853b None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:40.935169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 517/1035] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:40.940858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4cf7a-85ee-49a4-94cc-bf1aea643d65 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:40.941243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4cf7a-85ee-49a4-94cc-bf1aea643d65 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:40.941414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4cf7a-85ee-49a4-94cc-bf1aea643d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:40.965948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5cb4cf7a-85ee-49a4-94cc-bf1aea643d65 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:40.967079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5cb4cf7a-85ee-49a4-94cc-bf1aea643d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:40.974053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 519/1036] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:40 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:40.995994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988516d-f570-4a7e-b54d-5607eb3a853b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:41.009239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988516d-f570-4a7e-b54d-5607eb3a853b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:41.013308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912f18b-6042-4cc1-8166-d7bec24ca49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:41.014081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912f18b-6042-4cc1-8166-d7bec24ca49c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:41.014370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912f18b-6042-4cc1-8166-d7bec24ca49c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:41.014656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912f18b-6042-4cc1-8166-d7bec24ca49c admin admin] PATH_INFO: `/v3/roles/3876294260db4719972a530e23d90b2f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:41.016007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912f18b-6042-4cc1-8166-d7bec24ca49c admin admin] RBAC: Authorizing `identity:get_role(role_id=3876294260db4719972a530e23d90b2f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:41.041668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-6912f18b-6042-4cc1-8166-d7bec24ca49c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:42:41.041668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 12:42:41.041668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 12:42:41.042808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912f18b-6042-4cc1-8166-d7bec24ca49c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:41.044159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 518/1037] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:40 2022] GET /identity/v3/roles/3876294260db4719972a530e23d90b2f => generated 223 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:41.051142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4cf7a-85ee-49a4-94cc-bf1aea643d65 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:41.059936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4cf7a-85ee-49a4-94cc-bf1aea643d65 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:41.064167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da471cc-b110-4734-bf51-f2fd18dccc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:41.065282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da471cc-b110-4734-bf51-f2fd18dccc7d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:41.065578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da471cc-b110-4734-bf51-f2fd18dccc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:41.065865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da471cc-b110-4734-bf51-f2fd18dccc7d admin admin] PATH_INFO: `/v3/users/d363a5ec9e1246499cccc589b5e8a6bd` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:41.066986 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da471cc-b110-4734-bf51-f2fd18dccc7d admin admin] RBAC: Authorizing `identity:get_user(user_id=d363a5ec9e1246499cccc589b5e8a6bd)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:41.093851 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da471cc-b110-4734-bf51-f2fd18dccc7d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:41.095508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 520/1038] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:41 2022] GET /identity/v3/users/d363a5ec9e1246499cccc589b5e8a6bd => generated 286 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:42:41.102133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912f18b-6042-4cc1-8166-d7bec24ca49c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:41.112594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912f18b-6042-4cc1-8166-d7bec24ca49c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:41.116998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b3fcfc-375a-43a3-894e-bebe06365345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:41.117780 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3fcfc-375a-43a3-894e-bebe06365345 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:41.118070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3fcfc-375a-43a3-894e-bebe06365345 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:41.118351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3fcfc-375a-43a3-894e-bebe06365345 admin admin] PATH_INFO: `/v3/projects/15f72aeccb644494a5efc48bc0da913d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:41.119484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3fcfc-375a-43a3-894e-bebe06365345 admin admin] RBAC: Authorizing `identity:get_project(project_id=15f72aeccb644494a5efc48bc0da913d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:41.147497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b3fcfc-375a-43a3-894e-bebe06365345 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:41.149169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 519/1039] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:42:41 2022] GET /identity/v3/projects/15f72aeccb644494a5efc48bc0da913d => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:41.155100 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da471cc-b110-4734-bf51-f2fd18dccc7d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:41.166149 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da471cc-b110-4734-bf51-f2fd18dccc7d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:41.170633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef916d-f088-43f5-8c81-4e59f5c474e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:41.171477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef916d-f088-43f5-8c81-4e59f5c474e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:41.171767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef916d-f088-43f5-8c81-4e59f5c474e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:41.172057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef916d-f088-43f5-8c81-4e59f5c474e0 admin admin] PATH_INFO: `/v3/projects/15f72aeccb644494a5efc48bc0da913d/users/d363a5ec9e1246499cccc589b5e8a6bd/roles/3876294260db4719972a530e23d90b2f` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:41.174653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef916d-f088-43f5-8c81-4e59f5c474e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f72aeccb644494a5efc48bc0da913d, user_id=d363a5ec9e1246499cccc589b5e8a6bd, role_id=3876294260db4719972a530e23d90b2f)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:41.202385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef916d-f088-43f5-8c81-4e59f5c474e0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:41.302169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 521/1040] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:42:41 2022] PUT /identity/v3/projects/15f72aeccb644494a5efc48bc0da913d/users/d363a5ec9e1246499cccc589b5e8a6bd/roles/3876294260db4719972a530e23d90b2f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:42:43.347286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e0c1-397a-4a9d-a9c2-7c410cf06d50 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:43.347804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e0c1-397a-4a9d-a9c2-7c410cf06d50 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:43.347804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2e0c1-397a-4a9d-a9c2-7c410cf06d50 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:43.349469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 520/1041] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:43.354577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ce2b5-66f4-4c54-a731-99660af717d0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:43.355019 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ce2b5-66f4-4c54-a731-99660af717d0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:43.355150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ce2b5-66f4-4c54-a731-99660af717d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:43.379176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-481ce2b5-66f4-4c54-a731-99660af717d0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:43.380334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-481ce2b5-66f4-4c54-a731-99660af717d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:43.445436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 522/1042] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:43 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:43.468786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2e0c1-397a-4a9d-a9c2-7c410cf06d50 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:43.480791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2e0c1-397a-4a9d-a9c2-7c410cf06d50 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:43.484899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c2e1f-91a0-45ea-b710-560f8f1ed961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:43.485681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c2e1f-91a0-45ea-b710-560f8f1ed961 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:43.485971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c2e1f-91a0-45ea-b710-560f8f1ed961 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:43.486235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c2e1f-91a0-45ea-b710-560f8f1ed961 admin admin] PATH_INFO: `/v3/roles/3876294260db4719972a530e23d90b2f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:43.488237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c2e1f-91a0-45ea-b710-560f8f1ed961 admin admin] RBAC: Authorizing `identity:get_role(role_id=3876294260db4719972a530e23d90b2f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:43.514436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c2e1f-91a0-45ea-b710-560f8f1ed961 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:43.515866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 521/1043] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:43 2022] GET /identity/v3/roles/3876294260db4719972a530e23d90b2f => generated 223 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:43.522611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ce2b5-66f4-4c54-a731-99660af717d0 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:43.532058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ce2b5-66f4-4c54-a731-99660af717d0 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:43.537815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380bfd2-a17c-47e4-ad43-1b6b360ae7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:43.538676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380bfd2-a17c-47e4-ad43-1b6b360ae7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:43.538964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380bfd2-a17c-47e4-ad43-1b6b360ae7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:43.539242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380bfd2-a17c-47e4-ad43-1b6b360ae7a6 admin admin] PATH_INFO: `/v3/users/d363a5ec9e1246499cccc589b5e8a6bd` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:43.540397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380bfd2-a17c-47e4-ad43-1b6b360ae7a6 admin admin] RBAC: Authorizing `identity:get_user(user_id=d363a5ec9e1246499cccc589b5e8a6bd)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:43.566670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380bfd2-a17c-47e4-ad43-1b6b360ae7a6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:43.568289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 523/1044] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:43 2022] GET /identity/v3/users/d363a5ec9e1246499cccc589b5e8a6bd => generated 286 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:42:43.574250 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c2e1f-91a0-45ea-b710-560f8f1ed961 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:43.584267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c2e1f-91a0-45ea-b710-560f8f1ed961 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:43.588388 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef14118-a664-449a-893d-f230a0bc7f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:43.589055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14118-a664-449a-893d-f230a0bc7f5d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:43.589339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14118-a664-449a-893d-f230a0bc7f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:43.589618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef14118-a664-449a-893d-f230a0bc7f5d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:43.599637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef14118-a664-449a-893d-f230a0bc7f5d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:43.625110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef14118-a664-449a-893d-f230a0bc7f5d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:43.634517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 522/1045] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:42:43 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:42:43.640549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380bfd2-a17c-47e4-ad43-1b6b360ae7a6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:43.650456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380bfd2-a17c-47e4-ad43-1b6b360ae7a6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:43.654560 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4fa11-12c5-4a62-a723-ab454c3854ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:43.655354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4fa11-12c5-4a62-a723-ab454c3854ad admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:43.655647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4fa11-12c5-4a62-a723-ab454c3854ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:43.655926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4fa11-12c5-4a62-a723-ab454c3854ad admin admin] PATH_INFO: `/v3/projects/15f72aeccb644494a5efc48bc0da913d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:43.657004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4fa11-12c5-4a62-a723-ab454c3854ad admin admin] RBAC: Authorizing `identity:get_project(project_id=15f72aeccb644494a5efc48bc0da913d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:43.683685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4fa11-12c5-4a62-a723-ab454c3854ad admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:43.685291 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 524/1046] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:42:43 2022] GET /identity/v3/projects/15f72aeccb644494a5efc48bc0da913d => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:43.691379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef14118-a664-449a-893d-f230a0bc7f5d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:43.703704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef14118-a664-449a-893d-f230a0bc7f5d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:43.708601 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb41a22-2020-47ba-9f72-b5bd7d5a83a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:43.709185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41a22-2020-47ba-9f72-b5bd7d5a83a6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:43.709472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41a22-2020-47ba-9f72-b5bd7d5a83a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:43.709756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb41a22-2020-47ba-9f72-b5bd7d5a83a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:43.710534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb41a22-2020-47ba-9f72-b5bd7d5a83a6 admin admin] RBAC: Adding query filter params (role.id=3876294260db4719972a530e23d90b2f, scope.project.id=15f72aeccb644494a5efc48bc0da913d, user.id=d363a5ec9e1246499cccc589b5e8a6bd) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:43.710841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb41a22-2020-47ba-9f72-b5bd7d5a83a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:43.737022 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb41a22-2020-47ba-9f72-b5bd7d5a83a6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:43.743472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 523/1047] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:42:43 2022] GET /identity/v3/role_assignments?user.id=d363a5ec9e1246499cccc589b5e8a6bd&scope.project.id=15f72aeccb644494a5efc48bc0da913d&role.id=3876294260db4719972a530e23d90b2f => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:45.784806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeac44-d0d3-4f64-a1e6-e2ec9d781b7d None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:45.785415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeac44-d0d3-4f64-a1e6-e2ec9d781b7d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:45.785415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeac44-d0d3-4f64-a1e6-e2ec9d781b7d None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:45.787058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 525/1048] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:45.792474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd6d2a-70f2-49d9-93d8-dd49ae77cfda None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:45.792916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd6d2a-70f2-49d9-93d8-dd49ae77cfda None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:45.793040 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd6d2a-70f2-49d9-93d8-dd49ae77cfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:45.815999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-56cd6d2a-70f2-49d9-93d8-dd49ae77cfda None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:45.817132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-56cd6d2a-70f2-49d9-93d8-dd49ae77cfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:45.824058 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 524/1049] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:45 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:45.848496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeac44-d0d3-4f64-a1e6-e2ec9d781b7d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:45.860331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeac44-d0d3-4f64-a1e6-e2ec9d781b7d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:45.864467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21207cb5-d229-4a80-ba3f-1d238f610a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:45.865180 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21207cb5-d229-4a80-ba3f-1d238f610a30 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:45.865467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21207cb5-d229-4a80-ba3f-1d238f610a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:45.865747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21207cb5-d229-4a80-ba3f-1d238f610a30 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:45.866832 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21207cb5-d229-4a80-ba3f-1d238f610a30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:45.892155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21207cb5-d229-4a80-ba3f-1d238f610a30 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:45.894182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 526/1050] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:45.900146 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd6d2a-70f2-49d9-93d8-dd49ae77cfda None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:45.910043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd6d2a-70f2-49d9-93d8-dd49ae77cfda None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:45.914236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be648c-8dcd-443a-9291-be50089fd009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:45.914821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be648c-8dcd-443a-9291-be50089fd009 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:45.915111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be648c-8dcd-443a-9291-be50089fd009 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:45.915425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be648c-8dcd-443a-9291-be50089fd009 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:45.916074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be648c-8dcd-443a-9291-be50089fd009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:45.942679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be648c-8dcd-443a-9291-be50089fd009 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:46.022958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 525/1051] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:42:45 2022] POST /identity/v3/projects => generated 311 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:42:48.109975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f88e0-9d12-4bbe-9be1-415225f667b8 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:48.110541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f88e0-9d12-4bbe-9be1-415225f667b8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:48.110541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f88e0-9d12-4bbe-9be1-415225f667b8 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:48.112289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 527/1052] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:48.117611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eef6e0-8502-4942-952d-cf3267899fbe None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:48.118025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eef6e0-8502-4942-952d-cf3267899fbe None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:48.118183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eef6e0-8502-4942-952d-cf3267899fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:48.139646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-12eef6e0-8502-4942-952d-cf3267899fbe None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:48.140779 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-12eef6e0-8502-4942-952d-cf3267899fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:48.203906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 526/1053] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:48 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:42:48.228784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f88e0-9d12-4bbe-9be1-415225f667b8 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:48.240343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f88e0-9d12-4bbe-9be1-415225f667b8 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:48.244330 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb90245-ee8d-46fd-b6de-8f4ed8326f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:48.245033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb90245-ee8d-46fd-b6de-8f4ed8326f75 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:48.245311 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb90245-ee8d-46fd-b6de-8f4ed8326f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:48.245587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb90245-ee8d-46fd-b6de-8f4ed8326f75 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:48.246665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb90245-ee8d-46fd-b6de-8f4ed8326f75 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:48.272385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb90245-ee8d-46fd-b6de-8f4ed8326f75 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:48.273834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 528/1054] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:48.279512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eef6e0-8502-4942-952d-cf3267899fbe None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:48.289645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eef6e0-8502-4942-952d-cf3267899fbe None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:48.294042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708fb97-a575-42a1-b312-92ab59b8a27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:48.294628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708fb97-a575-42a1-b312-92ab59b8a27d admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:48.294910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708fb97-a575-42a1-b312-92ab59b8a27d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:48.295188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708fb97-a575-42a1-b312-92ab59b8a27d admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:48.295898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708fb97-a575-42a1-b312-92ab59b8a27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:48.322653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708fb97-a575-42a1-b312-92ab59b8a27d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:48.394540 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 527/1055] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:42:48 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:42:50.497201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cea01f-5f24-4e12-b3e4-b88f0c5e8606 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:50.497802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cea01f-5f24-4e12-b3e4-b88f0c5e8606 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:50.497802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cea01f-5f24-4e12-b3e4-b88f0c5e8606 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:50.499374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 529/1056] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:50.505777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6708a-756f-49d3-b31e-13bcb1621769 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:50.506275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6708a-756f-49d3-b31e-13bcb1621769 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:50.506427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6708a-756f-49d3-b31e-13bcb1621769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:50.531583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-e1f6708a-756f-49d3-b31e-13bcb1621769 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:50.532708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e1f6708a-756f-49d3-b31e-13bcb1621769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:50.540292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 528/1057] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:50 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:50.563699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cea01f-5f24-4e12-b3e4-b88f0c5e8606 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:50.576711 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cea01f-5f24-4e12-b3e4-b88f0c5e8606 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:50.581118 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7be90-afe8-4811-9c6d-bad7d3f51dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:50.581829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7be90-afe8-4811-9c6d-bad7d3f51dec admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:50.582114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7be90-afe8-4811-9c6d-bad7d3f51dec admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:50.582389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7be90-afe8-4811-9c6d-bad7d3f51dec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:50.594527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7be90-afe8-4811-9c6d-bad7d3f51dec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:42:50.601314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-15e7be90-afe8-4811-9c6d-bad7d3f51dec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:42:50.602441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 530/1058] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:50.611552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6708a-756f-49d3-b31e-13bcb1621769 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:50.620921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6708a-756f-49d3-b31e-13bcb1621769 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:50.625270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36540b-b786-40c4-9387-de21ea057c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:50.625880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36540b-b786-40c4-9387-de21ea057c12 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:50.626157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36540b-b786-40c4-9387-de21ea057c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:50.626437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a36540b-b786-40c4-9387-de21ea057c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:50.627151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36540b-b786-40c4-9387-de21ea057c12 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:50.627491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36540b-b786-40c4-9387-de21ea057c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:50.652519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a36540b-b786-40c4-9387-de21ea057c12 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:50.662466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 529/1059] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:42:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:50.668730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7be90-afe8-4811-9c6d-bad7d3f51dec admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:50.679291 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7be90-afe8-4811-9c6d-bad7d3f51dec admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:50.688323 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d5c22-6041-424e-857e-dc687e8fb55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:50.689134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d5c22-6041-424e-857e-dc687e8fb55a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:50.690484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d5c22-6041-424e-857e-dc687e8fb55a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:50.690484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d5c22-6041-424e-857e-dc687e8fb55a admin admin] PATH_INFO: `/v3/users/07781d6c9a9b4f708ff604ff9974d9ca` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:50.713017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d5c22-6041-424e-857e-dc687e8fb55a admin admin] RBAC: Authorizing `identity:get_user(user_id=07781d6c9a9b4f708ff604ff9974d9ca)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:50.739249 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584d5c22-6041-424e-857e-dc687e8fb55a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:50.740919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 531/1060] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:50 2022] GET /identity/v3/users/07781d6c9a9b4f708ff604ff9974d9ca => generated 286 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:50.746820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36540b-b786-40c4-9387-de21ea057c12 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:50.757039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a36540b-b786-40c4-9387-de21ea057c12 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:50.761775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0196f-8bec-44e0-ae9a-ceef3c83bcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:50.762343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0196f-8bec-44e0-ae9a-ceef3c83bcca admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:50.762626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0196f-8bec-44e0-ae9a-ceef3c83bcca admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:50.762904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0196f-8bec-44e0-ae9a-ceef3c83bcca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:50.771750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0196f-8bec-44e0-ae9a-ceef3c83bcca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:50.797466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0196f-8bec-44e0-ae9a-ceef3c83bcca admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:50.806839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 530/1061] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:42:50 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 12:42:50.812926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d5c22-6041-424e-857e-dc687e8fb55a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:50.823779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584d5c22-6041-424e-857e-dc687e8fb55a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:50.828180 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab13188-51fd-4b07-adda-959c197f7ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:50.828968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab13188-51fd-4b07-adda-959c197f7ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:50.829255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab13188-51fd-4b07-adda-959c197f7ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:50.829535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab13188-51fd-4b07-adda-959c197f7ca6 admin admin] PATH_INFO: `/v3/projects/988f3d8cde054c43b19e2f861211cb0a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:50.831374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab13188-51fd-4b07-adda-959c197f7ca6 admin admin] RBAC: Authorizing `identity:get_project(project_id=988f3d8cde054c43b19e2f861211cb0a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:50.858151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab13188-51fd-4b07-adda-959c197f7ca6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:50.860004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 532/1062] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:42:50 2022] GET /identity/v3/projects/988f3d8cde054c43b19e2f861211cb0a => generated 311 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:50.866721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0196f-8bec-44e0-ae9a-ceef3c83bcca admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:50.875436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0196f-8bec-44e0-ae9a-ceef3c83bcca admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:50.879900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4639d-7c03-4320-a9a7-a96bde6b4352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:50.880476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4639d-7c03-4320-a9a7-a96bde6b4352 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:50.880760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4639d-7c03-4320-a9a7-a96bde6b4352 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:50.881035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4639d-7c03-4320-a9a7-a96bde6b4352 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:50.881813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4639d-7c03-4320-a9a7-a96bde6b4352 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=988f3d8cde054c43b19e2f861211cb0a, user.id=07781d6c9a9b4f708ff604ff9974d9ca) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:50.882113 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4639d-7c03-4320-a9a7-a96bde6b4352 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:50.910881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4639d-7c03-4320-a9a7-a96bde6b4352 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:50.918091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 531/1063] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:42:50 2022] GET /identity/v3/role_assignments?user.id=07781d6c9a9b4f708ff604ff9974d9ca&scope.project.id=988f3d8cde054c43b19e2f861211cb0a&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:53.043460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad95d98-34ef-42d7-9dd1-7ca27bf1b859 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:53.043990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad95d98-34ef-42d7-9dd1-7ca27bf1b859 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:53.043990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad95d98-34ef-42d7-9dd1-7ca27bf1b859 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:53.045689 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 533/1064] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:53.051098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409e38e-895d-4e45-ab66-78c6e25e5347 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:53.051560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409e38e-895d-4e45-ab66-78c6e25e5347 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:53.051695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409e38e-895d-4e45-ab66-78c6e25e5347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:53.074401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4409e38e-895d-4e45-ab66-78c6e25e5347 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:53.075566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4409e38e-895d-4e45-ab66-78c6e25e5347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:53.083193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 532/1065] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:53 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:53.105112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad95d98-34ef-42d7-9dd1-7ca27bf1b859 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:53.117168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad95d98-34ef-42d7-9dd1-7ca27bf1b859 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:53.121265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c402f-9fb5-4862-bf48-dd9641462023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:53.121978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c402f-9fb5-4862-bf48-dd9641462023 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:53.122266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c402f-9fb5-4862-bf48-dd9641462023 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:53.122547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c402f-9fb5-4862-bf48-dd9641462023 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:53.134531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c402f-9fb5-4862-bf48-dd9641462023 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:42:53.140880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-f12c402f-9fb5-4862-bf48-dd9641462023 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:42:53.142009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 534/1066] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:53.149030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409e38e-895d-4e45-ab66-78c6e25e5347 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:53.157808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409e38e-895d-4e45-ab66-78c6e25e5347 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:53.162398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bbd77-9344-4306-97d4-16919e3513c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:53.162994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bbd77-9344-4306-97d4-16919e3513c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:53.163279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bbd77-9344-4306-97d4-16919e3513c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:53.163584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bbd77-9344-4306-97d4-16919e3513c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:53.164298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bbd77-9344-4306-97d4-16919e3513c3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:53.164593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bbd77-9344-4306-97d4-16919e3513c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:53.190568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bbd77-9344-4306-97d4-16919e3513c3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:53.199792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 533/1067] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:53.206666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c402f-9fb5-4862-bf48-dd9641462023 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:53.217025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c402f-9fb5-4862-bf48-dd9641462023 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:53.221112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad2de1-b6a7-4804-8d89-150a1ad68db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:53.222487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad2de1-b6a7-4804-8d89-150a1ad68db2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:53.222772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad2de1-b6a7-4804-8d89-150a1ad68db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:53.223050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad2de1-b6a7-4804-8d89-150a1ad68db2 admin admin] PATH_INFO: `/v3/users/07781d6c9a9b4f708ff604ff9974d9ca` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:53.224225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad2de1-b6a7-4804-8d89-150a1ad68db2 admin admin] RBAC: Authorizing `identity:get_user(user_id=07781d6c9a9b4f708ff604ff9974d9ca)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:53.263105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad2de1-b6a7-4804-8d89-150a1ad68db2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:53.264779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 535/1068] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:53 2022] GET /identity/v3/users/07781d6c9a9b4f708ff604ff9974d9ca => generated 286 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:53.271274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bbd77-9344-4306-97d4-16919e3513c3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:53.281164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bbd77-9344-4306-97d4-16919e3513c3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:53.286390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd12a1-f0d6-4c44-8006-2209779a414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:53.287409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd12a1-f0d6-4c44-8006-2209779a414c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:53.287837 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd12a1-f0d6-4c44-8006-2209779a414c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:53.288119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd12a1-f0d6-4c44-8006-2209779a414c admin admin] PATH_INFO: `/v3/projects/988f3d8cde054c43b19e2f861211cb0a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:53.289236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd12a1-f0d6-4c44-8006-2209779a414c admin admin] RBAC: Authorizing `identity:get_project(project_id=988f3d8cde054c43b19e2f861211cb0a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:53.320746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd12a1-f0d6-4c44-8006-2209779a414c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:53.322366 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 534/1069] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:42:53 2022] GET /identity/v3/projects/988f3d8cde054c43b19e2f861211cb0a => generated 311 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:53.328544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad2de1-b6a7-4804-8d89-150a1ad68db2 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:53.338920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad2de1-b6a7-4804-8d89-150a1ad68db2 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:53.343139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0238f-6ee8-4825-909e-bd0984eaa0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:53.344009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0238f-6ee8-4825-909e-bd0984eaa0dc admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:53.344296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0238f-6ee8-4825-909e-bd0984eaa0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:53.344575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0238f-6ee8-4825-909e-bd0984eaa0dc admin admin] PATH_INFO: `/v3/projects/988f3d8cde054c43b19e2f861211cb0a/users/07781d6c9a9b4f708ff604ff9974d9ca/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:53.347193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0238f-6ee8-4825-909e-bd0984eaa0dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=988f3d8cde054c43b19e2f861211cb0a, user_id=07781d6c9a9b4f708ff604ff9974d9ca, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:53.373778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0238f-6ee8-4825-909e-bd0984eaa0dc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:53.466425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 536/1070] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:42:53 2022] PUT /identity/v3/projects/988f3d8cde054c43b19e2f861211cb0a/users/07781d6c9a9b4f708ff604ff9974d9ca/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:42:55.467136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e375f8-97cd-44ef-b254-84e1ab612911 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:55.467676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e375f8-97cd-44ef-b254-84e1ab612911 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:55.467676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e375f8-97cd-44ef-b254-84e1ab612911 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:55.469449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 535/1071] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:55.475468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01641b72-712d-4fa8-bab6-93b171f59b17 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:55.475943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01641b72-712d-4fa8-bab6-93b171f59b17 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:55.476033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01641b72-712d-4fa8-bab6-93b171f59b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:55.500722 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-01641b72-712d-4fa8-bab6-93b171f59b17 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:55.501858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-01641b72-712d-4fa8-bab6-93b171f59b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:55.567039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 537/1072] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:55 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:55.590749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e375f8-97cd-44ef-b254-84e1ab612911 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:55.606576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e375f8-97cd-44ef-b254-84e1ab612911 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:55.610684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262659f-76fb-44b2-9846-a584fe66c1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:55.611441 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262659f-76fb-44b2-9846-a584fe66c1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:55.611731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262659f-76fb-44b2-9846-a584fe66c1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:55.612071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262659f-76fb-44b2-9846-a584fe66c1e6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:55.624718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262659f-76fb-44b2-9846-a584fe66c1e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:42:55.631292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-2262659f-76fb-44b2-9846-a584fe66c1e6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:42:55.632459 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 536/1073] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:55.638600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01641b72-712d-4fa8-bab6-93b171f59b17 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:55.647935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01641b72-712d-4fa8-bab6-93b171f59b17 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:55.652257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086cf66-b5ff-4352-8130-b5d4d7e5ea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:55.652849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086cf66-b5ff-4352-8130-b5d4d7e5ea23 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:55.653138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086cf66-b5ff-4352-8130-b5d4d7e5ea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:55.653418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086cf66-b5ff-4352-8130-b5d4d7e5ea23 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:55.654122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086cf66-b5ff-4352-8130-b5d4d7e5ea23 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:55.654419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086cf66-b5ff-4352-8130-b5d4d7e5ea23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:55.681008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086cf66-b5ff-4352-8130-b5d4d7e5ea23 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:55.689881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 538/1074] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:55.696196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262659f-76fb-44b2-9846-a584fe66c1e6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:55.706376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262659f-76fb-44b2-9846-a584fe66c1e6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:55.710723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c41e9b-9742-4046-8bcc-a5a438d36a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:55.711563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41e9b-9742-4046-8bcc-a5a438d36a76 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:55.711848 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41e9b-9742-4046-8bcc-a5a438d36a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:55.712128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c41e9b-9742-4046-8bcc-a5a438d36a76 admin admin] PATH_INFO: `/v3/users/07781d6c9a9b4f708ff604ff9974d9ca` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:55.713261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c41e9b-9742-4046-8bcc-a5a438d36a76 admin admin] RBAC: Authorizing `identity:get_user(user_id=07781d6c9a9b4f708ff604ff9974d9ca)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:55.740097 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c41e9b-9742-4046-8bcc-a5a438d36a76 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:55.741637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 537/1075] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:42:55 2022] GET /identity/v3/users/07781d6c9a9b4f708ff604ff9974d9ca => generated 286 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:42:55.747550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086cf66-b5ff-4352-8130-b5d4d7e5ea23 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:55.756999 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086cf66-b5ff-4352-8130-b5d4d7e5ea23 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:55.761228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc3a10-54eb-4de4-bca1-e9c23247c37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:55.761803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3a10-54eb-4de4-bca1-e9c23247c37a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:55.762089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3a10-54eb-4de4-bca1-e9c23247c37a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:55.762371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc3a10-54eb-4de4-bca1-e9c23247c37a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:55.770892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc3a10-54eb-4de4-bca1-e9c23247c37a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:55.796956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc3a10-54eb-4de4-bca1-e9c23247c37a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:55.805934 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 539/1076] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:42:55 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:42:55.811992 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c41e9b-9742-4046-8bcc-a5a438d36a76 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:55.822469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c41e9b-9742-4046-8bcc-a5a438d36a76 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:55.826545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e74fb-b402-4a75-8228-bddd269ab964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:55.827326 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e74fb-b402-4a75-8228-bddd269ab964 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:55.827626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e74fb-b402-4a75-8228-bddd269ab964 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:55.827909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e74fb-b402-4a75-8228-bddd269ab964 admin admin] PATH_INFO: `/v3/projects/988f3d8cde054c43b19e2f861211cb0a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:55.828986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e74fb-b402-4a75-8228-bddd269ab964 admin admin] RBAC: Authorizing `identity:get_project(project_id=988f3d8cde054c43b19e2f861211cb0a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:55.855826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e74fb-b402-4a75-8228-bddd269ab964 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:55.857355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 538/1077] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:42:55 2022] GET /identity/v3/projects/988f3d8cde054c43b19e2f861211cb0a => generated 311 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:55.863290 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc3a10-54eb-4de4-bca1-e9c23247c37a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:55.871784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc3a10-54eb-4de4-bca1-e9c23247c37a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:55.875907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5db7c6-87bf-4324-9e2b-3686b51be498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:55.876473 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db7c6-87bf-4324-9e2b-3686b51be498 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:55.876758 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db7c6-87bf-4324-9e2b-3686b51be498 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:55.877038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5db7c6-87bf-4324-9e2b-3686b51be498 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:55.878553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5db7c6-87bf-4324-9e2b-3686b51be498 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=988f3d8cde054c43b19e2f861211cb0a, user.id=07781d6c9a9b4f708ff604ff9974d9ca) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:55.878959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5db7c6-87bf-4324-9e2b-3686b51be498 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:55.905008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5db7c6-87bf-4324-9e2b-3686b51be498 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:55.910875 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 540/1078] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:42:55 2022] GET /identity/v3/role_assignments?user.id=07781d6c9a9b4f708ff604ff9974d9ca&scope.project.id=988f3d8cde054c43b19e2f861211cb0a&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:42:57.988944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268da3-38d1-410c-bffa-2d808ba89273 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:57.989490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268da3-38d1-410c-bffa-2d808ba89273 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:57.989490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268da3-38d1-410c-bffa-2d808ba89273 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:57.991161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 539/1079] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:42:57.996992 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793ace4-3d16-4a5a-af42-80a5b83afd97 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:57.997510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793ace4-3d16-4a5a-af42-80a5b83afd97 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:57.997653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793ace4-3d16-4a5a-af42-80a5b83afd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:58.022171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-4793ace4-3d16-4a5a-af42-80a5b83afd97 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:42:58.023356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-4793ace4-3d16-4a5a-af42-80a5b83afd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:42:58.030289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 541/1080] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:42:57 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:42:58.054536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a268da3-38d1-410c-bffa-2d808ba89273 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:58.069184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a268da3-38d1-410c-bffa-2d808ba89273 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:58.073438 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61962f-606e-4779-9bd8-a4e7f5b093de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:58.074028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61962f-606e-4779-9bd8-a4e7f5b093de admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:58.074316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61962f-606e-4779-9bd8-a4e7f5b093de admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:58.074602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61962f-606e-4779-9bd8-a4e7f5b093de admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:58.083675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61962f-606e-4779-9bd8-a4e7f5b093de admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:58.110304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61962f-606e-4779-9bd8-a4e7f5b093de admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:58.121086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 540/1081] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:42:58 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:42:58.127551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793ace4-3d16-4a5a-af42-80a5b83afd97 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:58.137171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793ace4-3d16-4a5a-af42-80a5b83afd97 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:58.141399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f406f0b-70c5-4531-9b3c-54ae7fadddeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:58.142134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406f0b-70c5-4531-9b3c-54ae7fadddeb admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:58.142424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406f0b-70c5-4531-9b3c-54ae7fadddeb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:58.142707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f406f0b-70c5-4531-9b3c-54ae7fadddeb admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:58.151854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f406f0b-70c5-4531-9b3c-54ae7fadddeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:58.182997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f406f0b-70c5-4531-9b3c-54ae7fadddeb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:58.206960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-1f406f0b-70c5-4531-9b3c-54ae7fadddeb admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 18 12:42:58.208220 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 542/1082] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:42:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:42:58.215428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61962f-606e-4779-9bd8-a4e7f5b093de admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:42:58.225543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61962f-606e-4779-9bd8-a4e7f5b093de admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:42:58.230339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022800c4-15e8-4871-84c2-0fc85ec10029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:42:58.230943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022800c4-15e8-4871-84c2-0fc85ec10029 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:42:58.231236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022800c4-15e8-4871-84c2-0fc85ec10029 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:42:58.231565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022800c4-15e8-4871-84c2-0fc85ec10029 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:42:58.232867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022800c4-15e8-4871-84c2-0fc85ec10029 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:42:58.233039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022800c4-15e8-4871-84c2-0fc85ec10029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:42:58.264553 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022800c4-15e8-4871-84c2-0fc85ec10029 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:42:58.273524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 541/1083] 10.222.0.87 () {56 vars in 1136 bytes} [Tue Jan 18 12:42:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:43:00.307862 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81d95-7962-475f-8122-02208eb37dba None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:00.308415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81d95-7962-475f-8122-02208eb37dba None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:00.308415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf81d95-7962-475f-8122-02208eb37dba None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:00.310092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 543/1084] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:43:00.316514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53095954-5edd-4cb4-bd02-25cc2ebf16b6 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:00.316982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53095954-5edd-4cb4-bd02-25cc2ebf16b6 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:00.317462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53095954-5edd-4cb4-bd02-25cc2ebf16b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:00.341122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-53095954-5edd-4cb4-bd02-25cc2ebf16b6 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:43:00.342192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-53095954-5edd-4cb4-bd02-25cc2ebf16b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:43:00.349346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 542/1085] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:43:00 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:43:00.372734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81d95-7962-475f-8122-02208eb37dba None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:00.386046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf81d95-7962-475f-8122-02208eb37dba None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:00.390199 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdab449-b567-47ed-a3c2-fadae1dde40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:00.390848 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdab449-b567-47ed-a3c2-fadae1dde40d admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:00.391175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdab449-b567-47ed-a3c2-fadae1dde40d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:00.391546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdab449-b567-47ed-a3c2-fadae1dde40d admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:00.392310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdab449-b567-47ed-a3c2-fadae1dde40d admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:00.418191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-abdab449-b567-47ed-a3c2-fadae1dde40d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 18 12:43:00.418191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 12:43:00.418191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 12:43:00.419094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdab449-b567-47ed-a3c2-fadae1dde40d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:00.520837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 544/1086] 10.222.0.87 () {60 vars in 1159 bytes} [Tue Jan 18 12:43:00 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:43:02.685985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d229-afb8-4b37-a4c1-a8ca98f87494 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:02.686522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d229-afb8-4b37-a4c1-a8ca98f87494 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:02.686522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d229-afb8-4b37-a4c1-a8ca98f87494 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:02.688266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 543/1087] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:43:02.695612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5a33-df86-423c-aa65-5320c08f6df0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:02.696124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5a33-df86-423c-aa65-5320c08f6df0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:02.696632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5a33-df86-423c-aa65-5320c08f6df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:02.728771 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b11a5a33-df86-423c-aa65-5320c08f6df0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:43:02.729933 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b11a5a33-df86-423c-aa65-5320c08f6df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:43:02.796361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 545/1088] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:43:02 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:43:02.819146 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5d229-afb8-4b37-a4c1-a8ca98f87494 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:02.831867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5d229-afb8-4b37-a4c1-a8ca98f87494 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:02.835843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7a053-2c8c-4547-bfda-0cd07814a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:02.836629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7a053-2c8c-4547-bfda-0cd07814a5fb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:02.836918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7a053-2c8c-4547-bfda-0cd07814a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:02.837201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7a053-2c8c-4547-bfda-0cd07814a5fb admin admin] PATH_INFO: `/v3/domains/ff827b721d19424e868dc384c67f07f1` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:02.850282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7a053-2c8c-4547-bfda-0cd07814a5fb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=ff827b721d19424e868dc384c67f07f1)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:02.876712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7a053-2c8c-4547-bfda-0cd07814a5fb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:02.879085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 544/1089] 10.222.0.87 () {56 vars in 1204 bytes} [Tue Jan 18 12:43:02 2022] GET /identity/v3/domains/ff827b721d19424e868dc384c67f07f1 => generated 267 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:02.888737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a5a33-df86-423c-aa65-5320c08f6df0 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:02.904094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a5a33-df86-423c-aa65-5320c08f6df0 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:02.911446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbbb1d-127b-4787-b8cb-1bd910a2a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:02.912436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbbb1d-127b-4787-b8cb-1bd910a2a522 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:02.912927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbbb1d-127b-4787-b8cb-1bd910a2a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:02.913414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbbb1d-127b-4787-b8cb-1bd910a2a522 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:02.914596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbbb1d-127b-4787-b8cb-1bd910a2a522 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:02.970395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbbb1d-127b-4787-b8cb-1bd910a2a522 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:03.083062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 546/1090] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:43:02 2022] POST /identity/v3/projects => generated 361 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:43:05.155329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36586ab3-3c8c-4d19-a71a-ad43e3f6af6a None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:05.155908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36586ab3-3c8c-4d19-a71a-ad43e3f6af6a None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:05.155908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36586ab3-3c8c-4d19-a71a-ad43e3f6af6a None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:05.157618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 545/1091] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 12:43:05.164393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0886a-0ec8-4156-b10c-ffb0d02e98b7 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:05.164908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0886a-0ec8-4156-b10c-ffb0d02e98b7 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:05.165066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0886a-0ec8-4156-b10c-ffb0d02e98b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:05.187712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-92d0886a-0ec8-4156-b10c-ffb0d02e98b7 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:43:05.188855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-92d0886a-0ec8-4156-b10c-ffb0d02e98b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:43:05.282577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 547/1092] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:43:05 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:43:05.309283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36586ab3-3c8c-4d19-a71a-ad43e3f6af6a None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:05.322930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36586ab3-3c8c-4d19-a71a-ad43e3f6af6a None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:05.327497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7d590-9fb9-4bc1-a928-1653f905ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:05.328307 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d590-9fb9-4bc1-a928-1653f905ef18 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:05.328594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d590-9fb9-4bc1-a928-1653f905ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:05.328868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7d590-9fb9-4bc1-a928-1653f905ef18 admin admin] PATH_INFO: `/v3/domains/ff827b721d19424e868dc384c67f07f1` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:05.330542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7d590-9fb9-4bc1-a928-1653f905ef18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=ff827b721d19424e868dc384c67f07f1)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:05.392709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7d590-9fb9-4bc1-a928-1653f905ef18 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:05.401490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 546/1093] 10.222.0.87 () {56 vars in 1204 bytes} [Tue Jan 18 12:43:05 2022] GET /identity/v3/domains/ff827b721d19424e868dc384c67f07f1 => generated 267 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:05.409547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0886a-0ec8-4156-b10c-ffb0d02e98b7 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:05.422188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0886a-0ec8-4156-b10c-ffb0d02e98b7 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:05.431073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea04e3-85ef-4013-8ba2-85d23a6430a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:05.432479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea04e3-85ef-4013-8ba2-85d23a6430a3 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:05.433237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea04e3-85ef-4013-8ba2-85d23a6430a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:05.433985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea04e3-85ef-4013-8ba2-85d23a6430a3 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:05.435469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea04e3-85ef-4013-8ba2-85d23a6430a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:05.493321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea04e3-85ef-4013-8ba2-85d23a6430a3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:05.587600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 548/1094] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:43:05 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 12:43:07.767164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc54fd-d017-4a41-857b-1d2d06cca592 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:07.767737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc54fd-d017-4a41-857b-1d2d06cca592 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:07.767737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc54fd-d017-4a41-857b-1d2d06cca592 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:07.770612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 547/1095] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:43:07.775925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66346dc-84d3-4bdb-aad5-f01bd3407c3b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:07.776595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66346dc-84d3-4bdb-aad5-f01bd3407c3b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:07.776595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66346dc-84d3-4bdb-aad5-f01bd3407c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:07.799620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e66346dc-84d3-4bdb-aad5-f01bd3407c3b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:43:07.801325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e66346dc-84d3-4bdb-aad5-f01bd3407c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:43:07.808297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 549/1096] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:43:07 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:43:07.831052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc54fd-d017-4a41-857b-1d2d06cca592 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:07.842763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc54fd-d017-4a41-857b-1d2d06cca592 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:07.847348 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4250db-22d5-47fb-9a4b-b1b88fa81260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:07.848068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4250db-22d5-47fb-9a4b-b1b88fa81260 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:07.848356 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4250db-22d5-47fb-9a4b-b1b88fa81260 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:07.848631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4250db-22d5-47fb-9a4b-b1b88fa81260 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:07.859814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4250db-22d5-47fb-9a4b-b1b88fa81260 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:43:07.866819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-4a4250db-22d5-47fb-9a4b-b1b88fa81260 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:43:07.868175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 548/1097] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:43:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:43:07.874226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66346dc-84d3-4bdb-aad5-f01bd3407c3b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:07.884905 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66346dc-84d3-4bdb-aad5-f01bd3407c3b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:07.889094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3e41f-02b8-4711-8bc7-995b6124128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:07.889692 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3e41f-02b8-4711-8bc7-995b6124128d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:07.889982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3e41f-02b8-4711-8bc7-995b6124128d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:07.890272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3e41f-02b8-4711-8bc7-995b6124128d admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:07.890983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3e41f-02b8-4711-8bc7-995b6124128d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:43:07.891286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3e41f-02b8-4711-8bc7-995b6124128d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:07.920689 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3e41f-02b8-4711-8bc7-995b6124128d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:07.931059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 550/1098] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:43:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:07.937118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4250db-22d5-47fb-9a4b-b1b88fa81260 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:07.948933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4250db-22d5-47fb-9a4b-b1b88fa81260 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:07.953298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bf140-908e-4e76-9aaf-454d2bdd78c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:07.954112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bf140-908e-4e76-9aaf-454d2bdd78c2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:07.954393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bf140-908e-4e76-9aaf-454d2bdd78c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:07.954666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bf140-908e-4e76-9aaf-454d2bdd78c2 admin admin] PATH_INFO: `/v3/users/cb278dbf152943d4be16bca5f9564726` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:07.975558 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bf140-908e-4e76-9aaf-454d2bdd78c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cb278dbf152943d4be16bca5f9564726)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:08.001485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21bf140-908e-4e76-9aaf-454d2bdd78c2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:08.003612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 549/1099] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:43:07 2022] GET /identity/v3/users/cb278dbf152943d4be16bca5f9564726 => generated 311 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:08.009402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3e41f-02b8-4711-8bc7-995b6124128d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:08.019520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3e41f-02b8-4711-8bc7-995b6124128d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:08.023484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f3f4e-bd98-40aa-8620-9570150329ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:08.024053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f3f4e-bd98-40aa-8620-9570150329ec admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:08.024347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f3f4e-bd98-40aa-8620-9570150329ec admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:08.024626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f3f4e-bd98-40aa-8620-9570150329ec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:08.032629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f3f4e-bd98-40aa-8620-9570150329ec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:08.058395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f3f4e-bd98-40aa-8620-9570150329ec admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:08.068345 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 551/1100] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:43:08 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:43:08.074529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bf140-908e-4e76-9aaf-454d2bdd78c2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:08.084357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bf140-908e-4e76-9aaf-454d2bdd78c2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:08.088547 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c38729-e9b9-414a-bf59-325ef90c251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:08.089338 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c38729-e9b9-414a-bf59-325ef90c251a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:08.089626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c38729-e9b9-414a-bf59-325ef90c251a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:08.089907 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c38729-e9b9-414a-bf59-325ef90c251a admin admin] PATH_INFO: `/v3/projects/1117f315d9504eb48d577b68fe353f07` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:08.090989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c38729-e9b9-414a-bf59-325ef90c251a admin admin] RBAC: Authorizing `identity:get_project(project_id=1117f315d9504eb48d577b68fe353f07)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:08.117433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c38729-e9b9-414a-bf59-325ef90c251a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:08.119107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 550/1101] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:43:08 2022] GET /identity/v3/projects/1117f315d9504eb48d577b68fe353f07 => generated 361 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:43:08.125336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f3f4e-bd98-40aa-8620-9570150329ec admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:08.134516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f3f4e-bd98-40aa-8620-9570150329ec admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:08.138678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfe31c-e08a-49cd-a400-19b1304f690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:08.139247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe31c-e08a-49cd-a400-19b1304f690f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:08.139569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe31c-e08a-49cd-a400-19b1304f690f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:08.139854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfe31c-e08a-49cd-a400-19b1304f690f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:08.140623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfe31c-e08a-49cd-a400-19b1304f690f admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=1117f315d9504eb48d577b68fe353f07, user.id=cb278dbf152943d4be16bca5f9564726) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:43:08.140924 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfe31c-e08a-49cd-a400-19b1304f690f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:08.168062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfe31c-e08a-49cd-a400-19b1304f690f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:08.174188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 552/1102] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:43:08 2022] GET /identity/v3/role_assignments?user.id=cb278dbf152943d4be16bca5f9564726&scope.project.id=1117f315d9504eb48d577b68fe353f07&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:10.266199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4b910-7a1c-48d2-8634-0d58efd5ecbc None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:10.266721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4b910-7a1c-48d2-8634-0d58efd5ecbc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:10.266721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4b910-7a1c-48d2-8634-0d58efd5ecbc None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:10.268505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 551/1103] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:43:10.274372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40373d9a-1526-4f0f-9c03-05a38c448be1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:10.274913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40373d9a-1526-4f0f-9c03-05a38c448be1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:10.274913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40373d9a-1526-4f0f-9c03-05a38c448be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:10.298268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-40373d9a-1526-4f0f-9c03-05a38c448be1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:43:10.299459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-40373d9a-1526-4f0f-9c03-05a38c448be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:43:10.307557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 553/1104] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:43:10 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:43:10.330634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4b910-7a1c-48d2-8634-0d58efd5ecbc None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:10.342697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4b910-7a1c-48d2-8634-0d58efd5ecbc None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:10.346630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72023ded-5c10-4229-8692-fbb15a5f0d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:10.347891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72023ded-5c10-4229-8692-fbb15a5f0d8e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:10.348180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72023ded-5c10-4229-8692-fbb15a5f0d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:10.348463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72023ded-5c10-4229-8692-fbb15a5f0d8e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:10.359874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72023ded-5c10-4229-8692-fbb15a5f0d8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:43:10.366758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-72023ded-5c10-4229-8692-fbb15a5f0d8e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:43:10.367931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 552/1105] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:43:10.374277 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40373d9a-1526-4f0f-9c03-05a38c448be1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:10.383368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40373d9a-1526-4f0f-9c03-05a38c448be1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:10.387773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeed60-e728-4baa-827c-c1d1cee82e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:10.388405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeed60-e728-4baa-827c-c1d1cee82e16 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:10.388695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeed60-e728-4baa-827c-c1d1cee82e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:10.388979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeed60-e728-4baa-827c-c1d1cee82e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:10.389716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeed60-e728-4baa-827c-c1d1cee82e16 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:43:10.390022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeed60-e728-4baa-827c-c1d1cee82e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:10.416839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeed60-e728-4baa-827c-c1d1cee82e16 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:10.426834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 554/1106] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:10.432843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72023ded-5c10-4229-8692-fbb15a5f0d8e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:10.444016 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72023ded-5c10-4229-8692-fbb15a5f0d8e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:10.448280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a49bc-ab8f-4a77-9cc5-f7df6d3d9ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:10.449073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a49bc-ab8f-4a77-9cc5-f7df6d3d9ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:10.449354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a49bc-ab8f-4a77-9cc5-f7df6d3d9ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:10.449630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a49bc-ab8f-4a77-9cc5-f7df6d3d9ec2 admin admin] PATH_INFO: `/v3/users/cb278dbf152943d4be16bca5f9564726` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:10.450724 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a49bc-ab8f-4a77-9cc5-f7df6d3d9ec2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cb278dbf152943d4be16bca5f9564726)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:10.478011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a49bc-ab8f-4a77-9cc5-f7df6d3d9ec2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:10.479773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 553/1107] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:43:10 2022] GET /identity/v3/users/cb278dbf152943d4be16bca5f9564726 => generated 311 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:10.485733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeed60-e728-4baa-827c-c1d1cee82e16 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:10.496007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeed60-e728-4baa-827c-c1d1cee82e16 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:10.500363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a8f58-e9ef-4c04-a060-17866c57aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:10.501156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8f58-e9ef-4c04-a060-17866c57aa3c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:10.501439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8f58-e9ef-4c04-a060-17866c57aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:10.501743 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a8f58-e9ef-4c04-a060-17866c57aa3c admin admin] PATH_INFO: `/v3/projects/1117f315d9504eb48d577b68fe353f07` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:10.502871 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8f58-e9ef-4c04-a060-17866c57aa3c admin admin] RBAC: Authorizing `identity:get_project(project_id=1117f315d9504eb48d577b68fe353f07)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:10.530160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a8f58-e9ef-4c04-a060-17866c57aa3c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:10.531935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 555/1108] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:43:10 2022] GET /identity/v3/projects/1117f315d9504eb48d577b68fe353f07 => generated 361 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:10.538505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a49bc-ab8f-4a77-9cc5-f7df6d3d9ec2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:10.548897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a49bc-ab8f-4a77-9cc5-f7df6d3d9ec2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:10.554297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c93fe1-5dc9-45ec-b094-63595537504b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:10.555138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93fe1-5dc9-45ec-b094-63595537504b admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:10.555471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93fe1-5dc9-45ec-b094-63595537504b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:10.555756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c93fe1-5dc9-45ec-b094-63595537504b admin admin] PATH_INFO: `/v3/projects/1117f315d9504eb48d577b68fe353f07/users/cb278dbf152943d4be16bca5f9564726/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:10.557669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93fe1-5dc9-45ec-b094-63595537504b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1117f315d9504eb48d577b68fe353f07, user_id=cb278dbf152943d4be16bca5f9564726, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:10.585098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c93fe1-5dc9-45ec-b094-63595537504b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:10.688003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 554/1109] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:43:10 2022] PUT /identity/v3/projects/1117f315d9504eb48d577b68fe353f07/users/cb278dbf152943d4be16bca5f9564726/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:43:12.748852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd830d2-3ea0-45c3-94e7-9997cf74a52a None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:12.749424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd830d2-3ea0-45c3-94e7-9997cf74a52a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:12.749424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd830d2-3ea0-45c3-94e7-9997cf74a52a None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:12.751107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 556/1110] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:43:12.756231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e191d73-e489-45ae-9e74-1626b3b3eede None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:12.756648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e191d73-e489-45ae-9e74-1626b3b3eede None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:12.756785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e191d73-e489-45ae-9e74-1626b3b3eede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:12.779161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4e191d73-e489-45ae-9e74-1626b3b3eede None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:43:12.780327 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4e191d73-e489-45ae-9e74-1626b3b3eede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:43:12.843405 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 555/1111] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:43:12 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:43:12.867324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd830d2-3ea0-45c3-94e7-9997cf74a52a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:12.879657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd830d2-3ea0-45c3-94e7-9997cf74a52a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:12.883808 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9195a-e6bf-4488-99d3-c3bff8cfbb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:12.884528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9195a-e6bf-4488-99d3-c3bff8cfbb3d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:12.884815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9195a-e6bf-4488-99d3-c3bff8cfbb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:12.885095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9195a-e6bf-4488-99d3-c3bff8cfbb3d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:12.900444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b9195a-e6bf-4488-99d3-c3bff8cfbb3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:43:12.908384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-b3b9195a-e6bf-4488-99d3-c3bff8cfbb3d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:43:12.910381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 557/1112] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:43:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:43:12.916603 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e191d73-e489-45ae-9e74-1626b3b3eede None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:12.926066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e191d73-e489-45ae-9e74-1626b3b3eede None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:12.930213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848c88a-c158-4b76-9591-4303a9ccff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:12.930806 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848c88a-c158-4b76-9591-4303a9ccff0d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:12.931094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848c88a-c158-4b76-9591-4303a9ccff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:12.931446 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848c88a-c158-4b76-9591-4303a9ccff0d admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:12.932169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848c88a-c158-4b76-9591-4303a9ccff0d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:43:12.932468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848c88a-c158-4b76-9591-4303a9ccff0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:12.958419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848c88a-c158-4b76-9591-4303a9ccff0d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:12.967415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 556/1113] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:12.973845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9195a-e6bf-4488-99d3-c3bff8cfbb3d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:12.983144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9195a-e6bf-4488-99d3-c3bff8cfbb3d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:12.987302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc53be-c529-42c5-8825-8ddb5d7260a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:12.988158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc53be-c529-42c5-8825-8ddb5d7260a4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:12.988445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc53be-c529-42c5-8825-8ddb5d7260a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:12.988728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc53be-c529-42c5-8825-8ddb5d7260a4 admin admin] PATH_INFO: `/v3/users/cb278dbf152943d4be16bca5f9564726` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:12.989866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc53be-c529-42c5-8825-8ddb5d7260a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cb278dbf152943d4be16bca5f9564726)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:13.015960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc53be-c529-42c5-8825-8ddb5d7260a4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:13.017450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 558/1114] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 12:43:12 2022] GET /identity/v3/users/cb278dbf152943d4be16bca5f9564726 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:13.024296 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848c88a-c158-4b76-9591-4303a9ccff0d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:13.033755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848c88a-c158-4b76-9591-4303a9ccff0d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:13.038492 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f617d-4e58-4254-9584-255409f90deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:13.039065 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f617d-4e58-4254-9584-255409f90deb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:13.039384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f617d-4e58-4254-9584-255409f90deb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:13.039671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f617d-4e58-4254-9584-255409f90deb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:13.047520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f617d-4e58-4254-9584-255409f90deb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:13.073129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f617d-4e58-4254-9584-255409f90deb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:13.082859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 557/1115] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:43:13 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:43:13.088899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc53be-c529-42c5-8825-8ddb5d7260a4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:13.099276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc53be-c529-42c5-8825-8ddb5d7260a4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:13.103499 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b562a7-5841-4bd7-8925-f5696f211cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:13.104285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b562a7-5841-4bd7-8925-f5696f211cdf admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:13.104571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b562a7-5841-4bd7-8925-f5696f211cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:13.104852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b562a7-5841-4bd7-8925-f5696f211cdf admin admin] PATH_INFO: `/v3/projects/1117f315d9504eb48d577b68fe353f07` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:13.106051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b562a7-5841-4bd7-8925-f5696f211cdf admin admin] RBAC: Authorizing `identity:get_project(project_id=1117f315d9504eb48d577b68fe353f07)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:13.132182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b562a7-5841-4bd7-8925-f5696f211cdf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:13.133752 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 559/1116] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 12:43:13 2022] GET /identity/v3/projects/1117f315d9504eb48d577b68fe353f07 => generated 361 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:43:13.139837 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f617d-4e58-4254-9584-255409f90deb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:43:13.149565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f617d-4e58-4254-9584-255409f90deb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:43:13.154024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bddf2e8-ae9a-403a-af76-c6c29f521df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:43:13.154605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf2e8-ae9a-403a-af76-c6c29f521df5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:43:13.154889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf2e8-ae9a-403a-af76-c6c29f521df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:43:13.155169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bddf2e8-ae9a-403a-af76-c6c29f521df5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:43:13.155984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf2e8-ae9a-403a-af76-c6c29f521df5 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=1117f315d9504eb48d577b68fe353f07, user.id=cb278dbf152943d4be16bca5f9564726) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:43:13.156290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf2e8-ae9a-403a-af76-c6c29f521df5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:43:13.182459 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bddf2e8-ae9a-403a-af76-c6c29f521df5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:43:13.188910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 558/1117] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:43:13 2022] GET /identity/v3/role_assignments?user.id=cb278dbf152943d4be16bca5f9564726&scope.project.id=1117f315d9504eb48d577b68fe353f07&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:49:54.882127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b00c4c-0aa4-4929-bae2-bfbf971dc3d4 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:54.882769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b00c4c-0aa4-4929-bae2-bfbf971dc3d4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:54.882769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b00c4c-0aa4-4929-bae2-bfbf971dc3d4 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:54.885072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 560/1118] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:49:54.890366 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd7aaf-e8dd-4704-a8f8-5217d4a2ec57 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:54.890773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd7aaf-e8dd-4704-a8f8-5217d4a2ec57 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:54.890930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd7aaf-e8dd-4704-a8f8-5217d4a2ec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:54.977156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c9bd7aaf-e8dd-4704-a8f8-5217d4a2ec57 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:49:54.978351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c9bd7aaf-e8dd-4704-a8f8-5217d4a2ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:49:55.019034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 559/1119] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:49:55.043009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b00c4c-0aa4-4929-bae2-bfbf971dc3d4 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:55.054978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b00c4c-0aa4-4929-bae2-bfbf971dc3d4 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:55.060264 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce7d76-7b74-4cea-ba4d-d0a481fb2690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:55.061316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce7d76-7b74-4cea-ba4d-d0a481fb2690 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:55.061743 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce7d76-7b74-4cea-ba4d-d0a481fb2690 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:55.062194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce7d76-7b74-4cea-ba4d-d0a481fb2690 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:55.078697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce7d76-7b74-4cea-ba4d-d0a481fb2690 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:55.116673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce7d76-7b74-4cea-ba4d-d0a481fb2690 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:55.143517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-74ce7d76-7b74-4cea-ba4d-d0a481fb2690 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:49:55.144590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 561/1120] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:49:55.151135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd7aaf-e8dd-4704-a8f8-5217d4a2ec57 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:55.159926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd7aaf-e8dd-4704-a8f8-5217d4a2ec57 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:55.164082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829ea37-4ccd-4111-b39e-42d2128da3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:55.169722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ea37-4ccd-4111-b39e-42d2128da3fe admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:55.169722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ea37-4ccd-4111-b39e-42d2128da3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:55.169722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829ea37-4ccd-4111-b39e-42d2128da3fe admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:55.169722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829ea37-4ccd-4111-b39e-42d2128da3fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:49:55.169722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829ea37-4ccd-4111-b39e-42d2128da3fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:55.193221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829ea37-4ccd-4111-b39e-42d2128da3fe admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:55.206101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 560/1121] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:49:55.211947 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce7d76-7b74-4cea-ba4d-d0a481fb2690 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:55.221072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce7d76-7b74-4cea-ba4d-d0a481fb2690 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:55.225066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4305f0-19d1-47d4-9848-10ac90f961ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:55.225645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4305f0-19d1-47d4-9848-10ac90f961ef admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:55.225930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4305f0-19d1-47d4-9848-10ac90f961ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:55.226208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4305f0-19d1-47d4-9848-10ac90f961ef admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:55.226846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4305f0-19d1-47d4-9848-10ac90f961ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:55.253208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4305f0-19d1-47d4-9848-10ac90f961ef admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:55.388703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 562/1122] 10.222.0.87 () {60 vars in 1153 bytes} [Tue Jan 18 12:49:55 2022] POST /identity/v3/users => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:49:57.441810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111b28-3ae9-4c81-9988-408ffe1a42f0 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:57.442314 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111b28-3ae9-4c81-9988-408ffe1a42f0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:57.442314 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111b28-3ae9-4c81-9988-408ffe1a42f0 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:57.444021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 561/1123] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:49:57.449988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64549ac-025c-4d6b-bfbd-5b73da073b0f None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:57.454354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64549ac-025c-4d6b-bfbd-5b73da073b0f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:57.454354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64549ac-025c-4d6b-bfbd-5b73da073b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:57.473165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d64549ac-025c-4d6b-bfbd-5b73da073b0f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:49:57.474311 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d64549ac-025c-4d6b-bfbd-5b73da073b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:49:57.482453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 563/1124] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:49:57 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:49:57.507098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c111b28-3ae9-4c81-9988-408ffe1a42f0 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:57.519520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c111b28-3ae9-4c81-9988-408ffe1a42f0 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:57.523490 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45322e-92e7-417d-82ac-e5303df07187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:57.524195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45322e-92e7-417d-82ac-e5303df07187 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:57.525138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45322e-92e7-417d-82ac-e5303df07187 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:57.525319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45322e-92e7-417d-82ac-e5303df07187 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:57.536715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45322e-92e7-417d-82ac-e5303df07187 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:49:57.543970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-fa45322e-92e7-417d-82ac-e5303df07187 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:49:57.545082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 562/1125] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:49:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:49:57.551437 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64549ac-025c-4d6b-bfbd-5b73da073b0f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:57.560900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64549ac-025c-4d6b-bfbd-5b73da073b0f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:57.565129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e443dce-81ab-4474-a8fd-64adac18d3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:57.565803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e443dce-81ab-4474-a8fd-64adac18d3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:57.566095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e443dce-81ab-4474-a8fd-64adac18d3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:57.574718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e443dce-81ab-4474-a8fd-64adac18d3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:57.574718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e443dce-81ab-4474-a8fd-64adac18d3d9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:49:57.574718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e443dce-81ab-4474-a8fd-64adac18d3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:57.593424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e443dce-81ab-4474-a8fd-64adac18d3d9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:57.602226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 564/1126] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:49:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:49:57.609310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45322e-92e7-417d-82ac-e5303df07187 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:57.619719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45322e-92e7-417d-82ac-e5303df07187 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:57.623793 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95650-f0e0-418a-8205-73174de09c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:57.624486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95650-f0e0-418a-8205-73174de09c5a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:57.624770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95650-f0e0-418a-8205-73174de09c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:57.625050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95650-f0e0-418a-8205-73174de09c5a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:57.636948 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c95650-f0e0-418a-8205-73174de09c5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:57.662108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c95650-f0e0-418a-8205-73174de09c5a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:57.680458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b5c95650-f0e0-418a-8205-73174de09c5a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:49:57.682175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 563/1127] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:49:57.688384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e443dce-81ab-4474-a8fd-64adac18d3d9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:57.699407 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e443dce-81ab-4474-a8fd-64adac18d3d9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:57.703615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b211-1eb2-41df-bcd7-32623e68366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:57.704203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b211-1eb2-41df-bcd7-32623e68366f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:57.704585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b211-1eb2-41df-bcd7-32623e68366f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:57.705476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f38b211-1eb2-41df-bcd7-32623e68366f admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:57.705582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38b211-1eb2-41df-bcd7-32623e68366f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:49:57.705809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38b211-1eb2-41df-bcd7-32623e68366f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:57.732957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f38b211-1eb2-41df-bcd7-32623e68366f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:57.748814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 565/1128] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:49:57.754668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95650-f0e0-418a-8205-73174de09c5a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:57.764860 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95650-f0e0-418a-8205-73174de09c5a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:57.768976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b36fb-d3ae-4752-863e-4244cf8de08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:57.769695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b36fb-d3ae-4752-863e-4244cf8de08e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:57.769981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b36fb-d3ae-4752-863e-4244cf8de08e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:57.770264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b36fb-d3ae-4752-863e-4244cf8de08e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:57.782940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b36fb-d3ae-4752-863e-4244cf8de08e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:57.809762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b36fb-d3ae-4752-863e-4244cf8de08e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:57.828355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-922b36fb-d3ae-4752-863e-4244cf8de08e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 18 12:49:57.829459 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 564/1129] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:49:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:49:57.835379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b211-1eb2-41df-bcd7-32623e68366f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:57.845537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f38b211-1eb2-41df-bcd7-32623e68366f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:57.849756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ac522-7d95-4990-be8e-52c04b0d358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:57.850416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ac522-7d95-4990-be8e-52c04b0d358f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:57.850705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ac522-7d95-4990-be8e-52c04b0d358f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:57.850989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ac522-7d95-4990-be8e-52c04b0d358f admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:57.851817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ac522-7d95-4990-be8e-52c04b0d358f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:49:57.852117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ac522-7d95-4990-be8e-52c04b0d358f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:57.883353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ac522-7d95-4990-be8e-52c04b0d358f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:57.917846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 566/1130] 10.222.0.87 () {56 vars in 1164 bytes} [Tue Jan 18 12:49:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:49:57.925963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b36fb-d3ae-4752-863e-4244cf8de08e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:57.937333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b36fb-d3ae-4752-863e-4244cf8de08e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:57.941439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce6f14-7473-4c43-b47e-fb2f562fc78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:57.942013 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce6f14-7473-4c43-b47e-fb2f562fc78b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:57.942301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce6f14-7473-4c43-b47e-fb2f562fc78b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:57.942586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce6f14-7473-4c43-b47e-fb2f562fc78b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:57.951536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce6f14-7473-4c43-b47e-fb2f562fc78b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:57.978882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce6f14-7473-4c43-b47e-fb2f562fc78b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:57.988590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 565/1131] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:49:57 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:49:57.995965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ac522-7d95-4990-be8e-52c04b0d358f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:58.005216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ac522-7d95-4990-be8e-52c04b0d358f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:58.010303 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb6d28-9cba-45ec-8730-350911ccf7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:58.011035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb6d28-9cba-45ec-8730-350911ccf7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:58.011349 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb6d28-9cba-45ec-8730-350911ccf7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:58.011635 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb6d28-9cba-45ec-8730-350911ccf7a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:58.022847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb6d28-9cba-45ec-8730-350911ccf7a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:58.048925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb6d28-9cba-45ec-8730-350911ccf7a1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:58.065831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-ddeb6d28-9cba-45ec-8730-350911ccf7a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:49:58.066914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 567/1132] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:49:58.073433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce6f14-7473-4c43-b47e-fb2f562fc78b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:58.081839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce6f14-7473-4c43-b47e-fb2f562fc78b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:58.085938 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9b30-ed29-4e5b-b986-524dc4f6e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:58.086512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9b30-ed29-4e5b-b986-524dc4f6e253 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:58.086792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9b30-ed29-4e5b-b986-524dc4f6e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:58.087096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e9b30-ed29-4e5b-b986-524dc4f6e253 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:58.087808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9b30-ed29-4e5b-b986-524dc4f6e253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:49:58.088104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9b30-ed29-4e5b-b986-524dc4f6e253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:58.114774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e9b30-ed29-4e5b-b986-524dc4f6e253 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:58.128161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 566/1133] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:49:58.134157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb6d28-9cba-45ec-8730-350911ccf7a1 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:58.143332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb6d28-9cba-45ec-8730-350911ccf7a1 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:58.147346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048df00-b117-41d5-bc43-f72dace3579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:58.148038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048df00-b117-41d5-bc43-f72dace3579c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:58.148322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048df00-b117-41d5-bc43-f72dace3579c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:58.148596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048df00-b117-41d5-bc43-f72dace3579c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:58.157717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048df00-b117-41d5-bc43-f72dace3579c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:58.185028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048df00-b117-41d5-bc43-f72dace3579c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:58.198680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-2048df00-b117-41d5-bc43-f72dace3579c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:49:58.201254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 568/1134] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:49:58.206597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9b30-ed29-4e5b-b986-524dc4f6e253 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:58.217434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e9b30-ed29-4e5b-b986-524dc4f6e253 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:58.222212 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b0698-3093-4289-a0ec-52f8ecf4be78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:58.222863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0698-3093-4289-a0ec-52f8ecf4be78 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:58.223148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0698-3093-4289-a0ec-52f8ecf4be78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:58.223461 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b0698-3093-4289-a0ec-52f8ecf4be78 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:58.224512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0698-3093-4289-a0ec-52f8ecf4be78 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:49:58.225042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0698-3093-4289-a0ec-52f8ecf4be78 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:58.253365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b0698-3093-4289-a0ec-52f8ecf4be78 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:58.266692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 567/1135] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:49:58.272974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048df00-b117-41d5-bc43-f72dace3579c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:49:58.282543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048df00-b117-41d5-bc43-f72dace3579c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:49:58.286656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd958d2b-dbf7-4486-9724-be51d07a5a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:49:58.287217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd958d2b-dbf7-4486-9724-be51d07a5a25 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:49:58.287555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd958d2b-dbf7-4486-9724-be51d07a5a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:49:58.287839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd958d2b-dbf7-4486-9724-be51d07a5a25 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:49:58.288607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd958d2b-dbf7-4486-9724-be51d07a5a25 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=0a678f789e3549a3b634acc510c5d0f6) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:49:58.288931 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd958d2b-dbf7-4486-9724-be51d07a5a25 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:49:58.316509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd958d2b-dbf7-4486-9724-be51d07a5a25 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:49:58.322207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 569/1136] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:49:58 2022] GET /identity/v3/role_assignments?user.id=0a678f789e3549a3b634acc510c5d0f6&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:00.345580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531c56-d857-4455-b693-6880702da248 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.346093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531c56-d857-4455-b693-6880702da248 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.346093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531c56-d857-4455-b693-6880702da248 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.347779 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 568/1137] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:50:00.353624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854a98-7861-44e4-82c7-4fc93c3a0bfa None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.354061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854a98-7861-44e4-82c7-4fc93c3a0bfa None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.354188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854a98-7861-44e4-82c7-4fc93c3a0bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.377494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1a854a98-7861-44e4-82c7-4fc93c3a0bfa None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:50:00.378610 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1a854a98-7861-44e4-82c7-4fc93c3a0bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:50:00.385498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 570/1138] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:50:00 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:50:00.407319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531c56-d857-4455-b693-6880702da248 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:00.419742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531c56-d857-4455-b693-6880702da248 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:00.435712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b578e-fe57-487d-89c8-be1cce93c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:00.436444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b578e-fe57-487d-89c8-be1cce93c649 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.436730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b578e-fe57-487d-89c8-be1cce93c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.437009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b578e-fe57-487d-89c8-be1cce93c649 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.448306 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b578e-fe57-487d-89c8-be1cce93c649 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:50:00.454688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-176b578e-fe57-487d-89c8-be1cce93c649 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:50:00.455828 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 569/1139] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:00.461927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854a98-7861-44e4-82c7-4fc93c3a0bfa None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:00.470413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854a98-7861-44e4-82c7-4fc93c3a0bfa None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:00.474522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add73da1-ebc0-437d-b3b4-7cda25b26948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:00.475121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add73da1-ebc0-437d-b3b4-7cda25b26948 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.475427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add73da1-ebc0-437d-b3b4-7cda25b26948 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.475707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add73da1-ebc0-437d-b3b4-7cda25b26948 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.477901 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add73da1-ebc0-437d-b3b4-7cda25b26948 admin admin] RBAC: Adding query filter params (name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:00.477901 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add73da1-ebc0-437d-b3b4-7cda25b26948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:00.503063 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add73da1-ebc0-437d-b3b4-7cda25b26948 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:00.512746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 571/1140] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:00.518593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b578e-fe57-487d-89c8-be1cce93c649 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:00.530690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b578e-fe57-487d-89c8-be1cce93c649 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:00.534915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f21cfe-7ec5-49c8-991e-62c6a16a8cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:00.535655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f21cfe-7ec5-49c8-991e-62c6a16a8cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.535944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f21cfe-7ec5-49c8-991e-62c6a16a8cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.536224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f21cfe-7ec5-49c8-991e-62c6a16a8cf0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.548790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f21cfe-7ec5-49c8-991e-62c6a16a8cf0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:00.574798 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f21cfe-7ec5-49c8-991e-62c6a16a8cf0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:00.593326 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-08f21cfe-7ec5-49c8-991e-62c6a16a8cf0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:00.594449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 570/1141] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:00.600400 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add73da1-ebc0-437d-b3b4-7cda25b26948 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:00.610452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add73da1-ebc0-437d-b3b4-7cda25b26948 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:00.614586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207075a9-882e-4a16-a765-83fdcd8201e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:00.615164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207075a9-882e-4a16-a765-83fdcd8201e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.615485 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207075a9-882e-4a16-a765-83fdcd8201e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.615763 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207075a9-882e-4a16-a765-83fdcd8201e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.616444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207075a9-882e-4a16-a765-83fdcd8201e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:00.616744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207075a9-882e-4a16-a765-83fdcd8201e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:00.642814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207075a9-882e-4a16-a765-83fdcd8201e3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:00.655974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 572/1142] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:50:00.661747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f21cfe-7ec5-49c8-991e-62c6a16a8cf0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:00.673357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f21cfe-7ec5-49c8-991e-62c6a16a8cf0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:00.678226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345b860-2d70-45f9-b728-4fe512fac47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:00.678961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b860-2d70-45f9-b728-4fe512fac47f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.679249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b860-2d70-45f9-b728-4fe512fac47f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.679561 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345b860-2d70-45f9-b728-4fe512fac47f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.693218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345b860-2d70-45f9-b728-4fe512fac47f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:00.719550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345b860-2d70-45f9-b728-4fe512fac47f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:00.742785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-4345b860-2d70-45f9-b728-4fe512fac47f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 18 12:50:00.744744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 571/1143] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:00.750089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207075a9-882e-4a16-a765-83fdcd8201e3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:00.759799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207075a9-882e-4a16-a765-83fdcd8201e3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:00.764020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d93ef-1f5e-4f32-b76b-a44a8bd6082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:00.764620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d93ef-1f5e-4f32-b76b-a44a8bd6082e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.764908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d93ef-1f5e-4f32-b76b-a44a8bd6082e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.765190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d93ef-1f5e-4f32-b76b-a44a8bd6082e admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.765976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d93ef-1f5e-4f32-b76b-a44a8bd6082e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:00.766284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d93ef-1f5e-4f32-b76b-a44a8bd6082e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:00.792725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d93ef-1f5e-4f32-b76b-a44a8bd6082e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:00.822086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 573/1144] 10.222.0.87 () {56 vars in 1164 bytes} [Tue Jan 18 12:50:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:00.828036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345b860-2d70-45f9-b728-4fe512fac47f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:00.838264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345b860-2d70-45f9-b728-4fe512fac47f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:00.842422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8e86e-6c54-47da-b777-d3cc35b4ecef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:00.843132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8e86e-6c54-47da-b777-d3cc35b4ecef admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.843452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8e86e-6c54-47da-b777-d3cc35b4ecef admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.843730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8e86e-6c54-47da-b777-d3cc35b4ecef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.856205 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8e86e-6c54-47da-b777-d3cc35b4ecef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:00.882082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8e86e-6c54-47da-b777-d3cc35b4ecef admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:00.900418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-12b8e86e-6c54-47da-b777-d3cc35b4ecef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:00.901562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 572/1145] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:00.908038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d93ef-1f5e-4f32-b76b-a44a8bd6082e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:00.917937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d93ef-1f5e-4f32-b76b-a44a8bd6082e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:00.922414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f34ea-fc70-4929-be6a-545f2167ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:00.923009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f34ea-fc70-4929-be6a-545f2167ee69 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.923302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f34ea-fc70-4929-be6a-545f2167ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.923878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f34ea-fc70-4929-be6a-545f2167ee69 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.924573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f34ea-fc70-4929-be6a-545f2167ee69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:00.930526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f34ea-fc70-4929-be6a-545f2167ee69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:00.951025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f34ea-fc70-4929-be6a-545f2167ee69 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:00.965051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 574/1146] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:00.971092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8e86e-6c54-47da-b777-d3cc35b4ecef admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:00.981552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8e86e-6c54-47da-b777-d3cc35b4ecef admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:00.985905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6490359-955e-46cb-ad5f-518d6c614b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:00.986621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6490359-955e-46cb-ad5f-518d6c614b81 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:00.986909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6490359-955e-46cb-ad5f-518d6c614b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:00.987288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6490359-955e-46cb-ad5f-518d6c614b81 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:00.997006 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6490359-955e-46cb-ad5f-518d6c614b81 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:01.023492 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6490359-955e-46cb-ad5f-518d6c614b81 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:01.038737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-b6490359-955e-46cb-ad5f-518d6c614b81 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:50:01.040051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 573/1147] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:50:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:50:01.046560 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f34ea-fc70-4929-be6a-545f2167ee69 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:01.056459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f34ea-fc70-4929-be6a-545f2167ee69 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:01.060787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a91b40-bc13-46c9-abb1-10417d8bcc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:01.061366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a91b40-bc13-46c9-abb1-10417d8bcc45 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:01.061656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a91b40-bc13-46c9-abb1-10417d8bcc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:01.062017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a91b40-bc13-46c9-abb1-10417d8bcc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:01.062717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a91b40-bc13-46c9-abb1-10417d8bcc45 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:01.063023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a91b40-bc13-46c9-abb1-10417d8bcc45 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:01.089364 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a91b40-bc13-46c9-abb1-10417d8bcc45 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:01.103141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 575/1148] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:50:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:01.109367 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6490359-955e-46cb-ad5f-518d6c614b81 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:01.119753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6490359-955e-46cb-ad5f-518d6c614b81 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:01.124037 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64342ff-dccd-45bc-91d9-56998c90c8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:01.124845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64342ff-dccd-45bc-91d9-56998c90c8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:01.125127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64342ff-dccd-45bc-91d9-56998c90c8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:01.125404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64342ff-dccd-45bc-91d9-56998c90c8a0 admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/0a678f789e3549a3b634acc510c5d0f6/roles/021156a7816c4a96874e0a699028ceef` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:01.163524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64342ff-dccd-45bc-91d9-56998c90c8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=0a678f789e3549a3b634acc510c5d0f6, role_id=021156a7816c4a96874e0a699028ceef)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:01.191957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64342ff-dccd-45bc-91d9-56998c90c8a0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:01.298889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 574/1149] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:50:01 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/0a678f789e3549a3b634acc510c5d0f6/roles/021156a7816c4a96874e0a699028ceef => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:50:03.290128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff93f12-da75-4de4-9844-585747e26a01 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.290667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff93f12-da75-4de4-9844-585747e26a01 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.290667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff93f12-da75-4de4-9844-585747e26a01 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.292411 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 576/1150] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:50:03.297818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87519f-324f-4b11-80f2-693e68dc707f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.301044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87519f-324f-4b11-80f2-693e68dc707f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.301044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87519f-324f-4b11-80f2-693e68dc707f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.322277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-dc87519f-324f-4b11-80f2-693e68dc707f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:50:03.323448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dc87519f-324f-4b11-80f2-693e68dc707f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:50:03.389495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 575/1151] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:50:03 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 12:50:03.412688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff93f12-da75-4de4-9844-585747e26a01 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:03.424957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff93f12-da75-4de4-9844-585747e26a01 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:03.429000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a695bf-0600-42e8-8f89-38b2b048e9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:03.429714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a695bf-0600-42e8-8f89-38b2b048e9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.430002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a695bf-0600-42e8-8f89-38b2b048e9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.430281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a695bf-0600-42e8-8f89-38b2b048e9f0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.442106 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a695bf-0600-42e8-8f89-38b2b048e9f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:50:03.449262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-64a695bf-0600-42e8-8f89-38b2b048e9f0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 18 12:50:03.450427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 577/1152] 10.222.0.87 () {56 vars in 1123 bytes} [Tue Jan 18 12:50:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:03.456533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87519f-324f-4b11-80f2-693e68dc707f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:03.465307 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87519f-324f-4b11-80f2-693e68dc707f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:03.469481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583bd0-6c14-41f6-aa61-44964d30fc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:03.470083 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583bd0-6c14-41f6-aa61-44964d30fc8c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.470369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583bd0-6c14-41f6-aa61-44964d30fc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.470648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06583bd0-6c14-41f6-aa61-44964d30fc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.471393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583bd0-6c14-41f6-aa61-44964d30fc8c admin admin] RBAC: Adding query filter params (name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:03.471693 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583bd0-6c14-41f6-aa61-44964d30fc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:03.497260 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06583bd0-6c14-41f6-aa61-44964d30fc8c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:03.506118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 576/1153] 10.222.0.87 () {56 vars in 1124 bytes} [Tue Jan 18 12:50:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:50:03.512659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a695bf-0600-42e8-8f89-38b2b048e9f0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:03.522577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a695bf-0600-42e8-8f89-38b2b048e9f0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:03.527010 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea591c6d-5113-419b-a7c9-f0659435cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:03.527761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea591c6d-5113-419b-a7c9-f0659435cd3a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.528054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea591c6d-5113-419b-a7c9-f0659435cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.528461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea591c6d-5113-419b-a7c9-f0659435cd3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.540461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea591c6d-5113-419b-a7c9-f0659435cd3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:03.570769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea591c6d-5113-419b-a7c9-f0659435cd3a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:03.591630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-ea591c6d-5113-419b-a7c9-f0659435cd3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:03.592804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 578/1154] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:03.598646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583bd0-6c14-41f6-aa61-44964d30fc8c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:03.608321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06583bd0-6c14-41f6-aa61-44964d30fc8c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:03.612538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89a423-81ca-45cd-a68f-7d7a6745e216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:03.613122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89a423-81ca-45cd-a68f-7d7a6745e216 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.613411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89a423-81ca-45cd-a68f-7d7a6745e216 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.613696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89a423-81ca-45cd-a68f-7d7a6745e216 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.616413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89a423-81ca-45cd-a68f-7d7a6745e216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:03.616413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89a423-81ca-45cd-a68f-7d7a6745e216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:03.641670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89a423-81ca-45cd-a68f-7d7a6745e216 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:03.655150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 577/1155] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:03.660937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea591c6d-5113-419b-a7c9-f0659435cd3a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:03.671418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea591c6d-5113-419b-a7c9-f0659435cd3a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:03.676038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397d9f3-bb69-40c6-97fd-814602766bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:03.682058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397d9f3-bb69-40c6-97fd-814602766bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.682058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397d9f3-bb69-40c6-97fd-814602766bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.682058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397d9f3-bb69-40c6-97fd-814602766bd8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.690813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397d9f3-bb69-40c6-97fd-814602766bd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:03.717080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397d9f3-bb69-40c6-97fd-814602766bd8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:03.735785 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-c397d9f3-bb69-40c6-97fd-814602766bd8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 18 12:50:03.736889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 579/1156] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:03.742696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89a423-81ca-45cd-a68f-7d7a6745e216 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:03.752909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89a423-81ca-45cd-a68f-7d7a6745e216 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:03.757141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de8a5-84cf-4a03-a080-3dacd1b7c6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:03.757734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de8a5-84cf-4a03-a080-3dacd1b7c6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.758021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de8a5-84cf-4a03-a080-3dacd1b7c6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.758306 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de8a5-84cf-4a03-a080-3dacd1b7c6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.768553 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206de8a5-84cf-4a03-a080-3dacd1b7c6d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:03.768553 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206de8a5-84cf-4a03-a080-3dacd1b7c6d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:03.785002 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206de8a5-84cf-4a03-a080-3dacd1b7c6d0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:03.817718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 578/1157] 10.222.0.87 () {56 vars in 1164 bytes} [Tue Jan 18 12:50:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:03.823864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397d9f3-bb69-40c6-97fd-814602766bd8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:03.834148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397d9f3-bb69-40c6-97fd-814602766bd8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:03.838375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee954-34b2-40b9-b581-fac130908ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:03.843194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee954-34b2-40b9-b581-fac130908ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.843194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee954-34b2-40b9-b581-fac130908ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.843194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee954-34b2-40b9-b581-fac130908ae0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.847420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ee954-34b2-40b9-b581-fac130908ae0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:03.873917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ee954-34b2-40b9-b581-fac130908ae0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:03.884038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 580/1158] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:50:03 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:50:03.890230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de8a5-84cf-4a03-a080-3dacd1b7c6d0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:03.899584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de8a5-84cf-4a03-a080-3dacd1b7c6d0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:03.903704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaebefa-7936-4e50-94ae-e2981221362a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:03.904410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaebefa-7936-4e50-94ae-e2981221362a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.904691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaebefa-7936-4e50-94ae-e2981221362a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.904984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaebefa-7936-4e50-94ae-e2981221362a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.917087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaebefa-7936-4e50-94ae-e2981221362a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:03.943371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaebefa-7936-4e50-94ae-e2981221362a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:03.961000 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-cbaebefa-7936-4e50-94ae-e2981221362a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:03.962170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 579/1159] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:03.968198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee954-34b2-40b9-b581-fac130908ae0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:03.976882 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee954-34b2-40b9-b581-fac130908ae0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:03.981887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf35daf-1863-4f90-892d-c15adcad8172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:03.982469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35daf-1863-4f90-892d-c15adcad8172 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:03.982761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35daf-1863-4f90-892d-c15adcad8172 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:03.983042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf35daf-1863-4f90-892d-c15adcad8172 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:03.983762 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf35daf-1863-4f90-892d-c15adcad8172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:03.984065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf35daf-1863-4f90-892d-c15adcad8172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:04.010123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf35daf-1863-4f90-892d-c15adcad8172 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:04.023359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 581/1160] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:04.029353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaebefa-7936-4e50-94ae-e2981221362a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:04.038781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaebefa-7936-4e50-94ae-e2981221362a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:04.043485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366c74-1d48-4e4e-bc5c-e22cd8a11baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:04.044198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366c74-1d48-4e4e-bc5c-e22cd8a11baa admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:04.044481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366c74-1d48-4e4e-bc5c-e22cd8a11baa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:04.044779 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68366c74-1d48-4e4e-bc5c-e22cd8a11baa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:04.054401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366c74-1d48-4e4e-bc5c-e22cd8a11baa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:04.080488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68366c74-1d48-4e4e-bc5c-e22cd8a11baa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:04.096132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-68366c74-1d48-4e4e-bc5c-e22cd8a11baa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:50:04.097269 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 580/1161] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:04.103841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf35daf-1863-4f90-892d-c15adcad8172 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:04.113160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf35daf-1863-4f90-892d-c15adcad8172 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:04.117293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7e28e0-9ced-43a5-9cd3-6c438fbea509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:04.117870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e28e0-9ced-43a5-9cd3-6c438fbea509 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:04.118321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e28e0-9ced-43a5-9cd3-6c438fbea509 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:04.118321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7e28e0-9ced-43a5-9cd3-6c438fbea509 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:04.119257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e28e0-9ced-43a5-9cd3-6c438fbea509 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:04.119588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e28e0-9ced-43a5-9cd3-6c438fbea509 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:04.144795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7e28e0-9ced-43a5-9cd3-6c438fbea509 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:04.158657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 582/1162] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:04.164666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366c74-1d48-4e4e-bc5c-e22cd8a11baa admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:04.176212 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68366c74-1d48-4e4e-bc5c-e22cd8a11baa admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:04.180276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e7a3a-eb7f-461a-acf3-ddf268c2d838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:04.181124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e7a3a-eb7f-461a-acf3-ddf268c2d838 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:04.181249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e7a3a-eb7f-461a-acf3-ddf268c2d838 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:04.181525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e7a3a-eb7f-461a-acf3-ddf268c2d838 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:04.182293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e7a3a-eb7f-461a-acf3-ddf268c2d838 admin admin] RBAC: Adding query filter params (role.id=021156a7816c4a96874e0a699028ceef, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=0a678f789e3549a3b634acc510c5d0f6) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:04.182593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e7a3a-eb7f-461a-acf3-ddf268c2d838 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:04.208148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e7a3a-eb7f-461a-acf3-ddf268c2d838 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:04.214899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 581/1163] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:50:04 2022] GET /identity/v3/role_assignments?user.id=0a678f789e3549a3b634acc510c5d0f6&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=021156a7816c4a96874e0a699028ceef => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:50:06.266453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82161b-3891-4ddb-b084-9b6f1446471a None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.267007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82161b-3891-4ddb-b084-9b6f1446471a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.267007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82161b-3891-4ddb-b084-9b6f1446471a None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.268739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 583/1164] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:50:06.273960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26813f9-72e1-41d0-872f-f31bd1de1220 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.274409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26813f9-72e1-41d0-872f-f31bd1de1220 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.275236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26813f9-72e1-41d0-872f-f31bd1de1220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.297579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f26813f9-72e1-41d0-872f-f31bd1de1220 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:50:06.298970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f26813f9-72e1-41d0-872f-f31bd1de1220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:50:06.305980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 582/1165] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:50:06 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:50:06.328797 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82161b-3891-4ddb-b084-9b6f1446471a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.341753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82161b-3891-4ddb-b084-9b6f1446471a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.345724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d5f93-ed4a-45d5-9a52-749313ade939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.346374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d5f93-ed4a-45d5-9a52-749313ade939 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.346660 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d5f93-ed4a-45d5-9a52-749313ade939 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.346934 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d5f93-ed4a-45d5-9a52-749313ade939 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.358534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d5f93-ed4a-45d5-9a52-749313ade939 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:50:06.364740 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-254d5f93-ed4a-45d5-9a52-749313ade939 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:50:06.365837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 584/1166] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:06.372712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26813f9-72e1-41d0-872f-f31bd1de1220 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.381301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26813f9-72e1-41d0-872f-f31bd1de1220 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.386104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932406d5-75c7-4b90-908c-e35dd9f64d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.386697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932406d5-75c7-4b90-908c-e35dd9f64d57 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.386981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932406d5-75c7-4b90-908c-e35dd9f64d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.387259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932406d5-75c7-4b90-908c-e35dd9f64d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.387999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932406d5-75c7-4b90-908c-e35dd9f64d57 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:06.388300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932406d5-75c7-4b90-908c-e35dd9f64d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:06.413589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932406d5-75c7-4b90-908c-e35dd9f64d57 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:06.422680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 583/1167] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:06.428689 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d5f93-ed4a-45d5-9a52-749313ade939 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.439069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d5f93-ed4a-45d5-9a52-749313ade939 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.443247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36580a-658e-4665-a3fd-2c0618fa7909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.443982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36580a-658e-4665-a3fd-2c0618fa7909 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.444267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36580a-658e-4665-a3fd-2c0618fa7909 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.444545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36580a-658e-4665-a3fd-2c0618fa7909 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.456469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36580a-658e-4665-a3fd-2c0618fa7909 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:06.481739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36580a-658e-4665-a3fd-2c0618fa7909 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:06.504392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-cc36580a-658e-4665-a3fd-2c0618fa7909 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:06.505551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 585/1168] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:06.513782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932406d5-75c7-4b90-908c-e35dd9f64d57 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.523033 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932406d5-75c7-4b90-908c-e35dd9f64d57 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.528491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3681d7-5ad3-4b42-b565-d1765c04f37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.529085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3681d7-5ad3-4b42-b565-d1765c04f37a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.529376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3681d7-5ad3-4b42-b565-d1765c04f37a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.529667 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3681d7-5ad3-4b42-b565-d1765c04f37a admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.530364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3681d7-5ad3-4b42-b565-d1765c04f37a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:06.530666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3681d7-5ad3-4b42-b565-d1765c04f37a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:06.558613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3681d7-5ad3-4b42-b565-d1765c04f37a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:06.574501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 584/1169] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:06.580527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36580a-658e-4665-a3fd-2c0618fa7909 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.591161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36580a-658e-4665-a3fd-2c0618fa7909 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.595834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d7734-a45a-4663-9e2d-f005ceb5b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.596515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d7734-a45a-4663-9e2d-f005ceb5b9be admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.596812 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d7734-a45a-4663-9e2d-f005ceb5b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.597091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d7734-a45a-4663-9e2d-f005ceb5b9be admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.610916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d7734-a45a-4663-9e2d-f005ceb5b9be admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:06.638204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d7734-a45a-4663-9e2d-f005ceb5b9be admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:06.657116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-734d7734-a45a-4663-9e2d-f005ceb5b9be admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 18 12:50:06.658260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 586/1170] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:06.664187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3681d7-5ad3-4b42-b565-d1765c04f37a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.674203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3681d7-5ad3-4b42-b565-d1765c04f37a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.678330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9873fdf-2ec1-4aa3-a69a-0c152c07989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.678925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9873fdf-2ec1-4aa3-a69a-0c152c07989f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.683396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9873fdf-2ec1-4aa3-a69a-0c152c07989f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.683396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9873fdf-2ec1-4aa3-a69a-0c152c07989f admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.683396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9873fdf-2ec1-4aa3-a69a-0c152c07989f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:06.683396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9873fdf-2ec1-4aa3-a69a-0c152c07989f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:06.707283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9873fdf-2ec1-4aa3-a69a-0c152c07989f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:06.738236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 585/1171] 10.222.0.87 () {56 vars in 1164 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:06.745185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d7734-a45a-4663-9e2d-f005ceb5b9be admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.754593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d7734-a45a-4663-9e2d-f005ceb5b9be admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.758849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af61f8b-f70d-4f5a-b03e-8959309d86d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.759664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af61f8b-f70d-4f5a-b03e-8959309d86d1 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.759957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af61f8b-f70d-4f5a-b03e-8959309d86d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.760235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af61f8b-f70d-4f5a-b03e-8959309d86d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.768214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af61f8b-f70d-4f5a-b03e-8959309d86d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:06.795360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af61f8b-f70d-4f5a-b03e-8959309d86d1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:06.806405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 587/1172] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:50:06.812280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9873fdf-2ec1-4aa3-a69a-0c152c07989f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.821864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9873fdf-2ec1-4aa3-a69a-0c152c07989f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.826105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f020dac-002a-4519-9764-c3bac9392448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.826841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f020dac-002a-4519-9764-c3bac9392448 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.827131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f020dac-002a-4519-9764-c3bac9392448 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.827451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f020dac-002a-4519-9764-c3bac9392448 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.839556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f020dac-002a-4519-9764-c3bac9392448 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:06.865804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f020dac-002a-4519-9764-c3bac9392448 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:06.884288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-4f020dac-002a-4519-9764-c3bac9392448 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:06.885448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 586/1173] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:06.891764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af61f8b-f70d-4f5a-b03e-8959309d86d1 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.901093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af61f8b-f70d-4f5a-b03e-8959309d86d1 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.905376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f202ac-4e31-40e6-95cb-6de121412af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.905968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f202ac-4e31-40e6-95cb-6de121412af7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.906251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f202ac-4e31-40e6-95cb-6de121412af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.906613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f202ac-4e31-40e6-95cb-6de121412af7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.907258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f202ac-4e31-40e6-95cb-6de121412af7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:06.907584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f202ac-4e31-40e6-95cb-6de121412af7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:06.936132 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f202ac-4e31-40e6-95cb-6de121412af7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:06.950069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 588/1174] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:06.956334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f020dac-002a-4519-9764-c3bac9392448 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:06.966653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f020dac-002a-4519-9764-c3bac9392448 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:06.971534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c308bf9-307e-4910-be7d-41cf4d64b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:06.972295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c308bf9-307e-4910-be7d-41cf4d64b9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:06.972583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c308bf9-307e-4910-be7d-41cf4d64b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:06.972862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c308bf9-307e-4910-be7d-41cf4d64b9a1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:06.983898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c308bf9-307e-4910-be7d-41cf4d64b9a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:07.010741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c308bf9-307e-4910-be7d-41cf4d64b9a1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:07.027326 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-0c308bf9-307e-4910-be7d-41cf4d64b9a1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:50:07.028500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 587/1175] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:50:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:07.034601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f202ac-4e31-40e6-95cb-6de121412af7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:07.044950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f202ac-4e31-40e6-95cb-6de121412af7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:07.051496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09dfc90-58f9-4f35-bf2a-91cd57f61dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:07.052093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dfc90-58f9-4f35-bf2a-91cd57f61dff admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:07.052397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dfc90-58f9-4f35-bf2a-91cd57f61dff admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:07.052663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dfc90-58f9-4f35-bf2a-91cd57f61dff admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:07.053409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dfc90-58f9-4f35-bf2a-91cd57f61dff admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:07.053717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dfc90-58f9-4f35-bf2a-91cd57f61dff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:07.082784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09dfc90-58f9-4f35-bf2a-91cd57f61dff admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:07.097049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 589/1176] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:50:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:50:07.104526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c308bf9-307e-4910-be7d-41cf4d64b9a1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:07.114466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c308bf9-307e-4910-be7d-41cf4d64b9a1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:07.119060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d1c15-9d5c-4a45-a121-97e8ad040772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:07.119684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d1c15-9d5c-4a45-a121-97e8ad040772 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:07.120046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d1c15-9d5c-4a45-a121-97e8ad040772 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:07.120401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d1c15-9d5c-4a45-a121-97e8ad040772 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:07.121261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d1c15-9d5c-4a45-a121-97e8ad040772 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=0a678f789e3549a3b634acc510c5d0f6) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:07.121673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d1c15-9d5c-4a45-a121-97e8ad040772 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:07.148047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d1c15-9d5c-4a45-a121-97e8ad040772 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:07.154876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 588/1177] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:50:07 2022] GET /identity/v3/role_assignments?user.id=0a678f789e3549a3b634acc510c5d0f6&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 12:50:09.186737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657f815-04d4-49b1-9a52-70a95d3f42dc None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.187363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657f815-04d4-49b1-9a52-70a95d3f42dc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.187363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657f815-04d4-49b1-9a52-70a95d3f42dc None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.189153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 590/1178] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:50:09.195607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b546a7-fbbb-4f13-b3ca-14254c7f4d74 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.196749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b546a7-fbbb-4f13-b3ca-14254c7f4d74 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.196749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b546a7-fbbb-4f13-b3ca-14254c7f4d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.222827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-21b546a7-fbbb-4f13-b3ca-14254c7f4d74 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:50:09.224064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-21b546a7-fbbb-4f13-b3ca-14254c7f4d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:50:09.231745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 589/1179] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:50:09 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:50:09.255848 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657f815-04d4-49b1-9a52-70a95d3f42dc None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.269247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657f815-04d4-49b1-9a52-70a95d3f42dc None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.273676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b8805-4860-4813-ad62-96f912cfa148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.275015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b8805-4860-4813-ad62-96f912cfa148 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.275299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b8805-4860-4813-ad62-96f912cfa148 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.275607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b8805-4860-4813-ad62-96f912cfa148 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.288915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b8805-4860-4813-ad62-96f912cfa148 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:50:09.295793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-fd4b8805-4860-4813-ad62-96f912cfa148 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:50:09.297015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 591/1180] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:09.304328 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b546a7-fbbb-4f13-b3ca-14254c7f4d74 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.314114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b546a7-fbbb-4f13-b3ca-14254c7f4d74 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.318883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d5ebc-eb3b-450b-8c12-b1244b4c1982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.319594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d5ebc-eb3b-450b-8c12-b1244b4c1982 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.319888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d5ebc-eb3b-450b-8c12-b1244b4c1982 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.320174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d5ebc-eb3b-450b-8c12-b1244b4c1982 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.321441 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d5ebc-eb3b-450b-8c12-b1244b4c1982 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:09.321765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d5ebc-eb3b-450b-8c12-b1244b4c1982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:09.348881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d5ebc-eb3b-450b-8c12-b1244b4c1982 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:09.362224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 590/1181] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:09.369184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b8805-4860-4813-ad62-96f912cfa148 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.380698 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b8805-4860-4813-ad62-96f912cfa148 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.385772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1a824-d00c-4c38-9cb0-dd17bb4da593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.386521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1a824-d00c-4c38-9cb0-dd17bb4da593 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.386806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1a824-d00c-4c38-9cb0-dd17bb4da593 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.387083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1a824-d00c-4c38-9cb0-dd17bb4da593 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.401259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1a824-d00c-4c38-9cb0-dd17bb4da593 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:09.427557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1a824-d00c-4c38-9cb0-dd17bb4da593 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:09.449164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-86c1a824-d00c-4c38-9cb0-dd17bb4da593 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:09.450374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 592/1182] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:09.456792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d5ebc-eb3b-450b-8c12-b1244b4c1982 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.469372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d5ebc-eb3b-450b-8c12-b1244b4c1982 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.474198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bfda7-d509-4c94-85f9-1bb6edc53608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.474834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bfda7-d509-4c94-85f9-1bb6edc53608 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.475127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bfda7-d509-4c94-85f9-1bb6edc53608 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.475471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bfda7-d509-4c94-85f9-1bb6edc53608 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.476229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bfda7-d509-4c94-85f9-1bb6edc53608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:09.476538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bfda7-d509-4c94-85f9-1bb6edc53608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:09.504426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bfda7-d509-4c94-85f9-1bb6edc53608 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:09.520312 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 591/1183] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:09.527167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1a824-d00c-4c38-9cb0-dd17bb4da593 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.537182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1a824-d00c-4c38-9cb0-dd17bb4da593 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.544936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ba02f-caaa-4a3e-85d8-1a36d033c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.544936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ba02f-caaa-4a3e-85d8-1a36d033c05c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.544936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ba02f-caaa-4a3e-85d8-1a36d033c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.546113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ba02f-caaa-4a3e-85d8-1a36d033c05c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.559402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ba02f-caaa-4a3e-85d8-1a36d033c05c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:09.585597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27ba02f-caaa-4a3e-85d8-1a36d033c05c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:09.606714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-d27ba02f-caaa-4a3e-85d8-1a36d033c05c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 18 12:50:09.607850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 593/1184] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:09.614126 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bfda7-d509-4c94-85f9-1bb6edc53608 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.624984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bfda7-d509-4c94-85f9-1bb6edc53608 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.629509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16922d-3695-419c-a486-5c9af72806f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.630146 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16922d-3695-419c-a486-5c9af72806f7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.630429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16922d-3695-419c-a486-5c9af72806f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.630715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16922d-3695-419c-a486-5c9af72806f7 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.631575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16922d-3695-419c-a486-5c9af72806f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:09.631885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16922d-3695-419c-a486-5c9af72806f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:09.658810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16922d-3695-419c-a486-5c9af72806f7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:09.692586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 592/1185] 10.222.0.87 () {56 vars in 1164 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:09.699742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ba02f-caaa-4a3e-85d8-1a36d033c05c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.709282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ba02f-caaa-4a3e-85d8-1a36d033c05c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.715864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69849c03-9571-41ec-be31-c7fa3ba196c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.716575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69849c03-9571-41ec-be31-c7fa3ba196c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.716858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69849c03-9571-41ec-be31-c7fa3ba196c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.717141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69849c03-9571-41ec-be31-c7fa3ba196c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.729908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69849c03-9571-41ec-be31-c7fa3ba196c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:09.755260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69849c03-9571-41ec-be31-c7fa3ba196c5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:09.773261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-69849c03-9571-41ec-be31-c7fa3ba196c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:09.774996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 594/1186] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:09.781125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16922d-3695-419c-a486-5c9af72806f7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.791368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16922d-3695-419c-a486-5c9af72806f7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.795581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e28100-08f9-4c60-a5c4-1d13928ed8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.796167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e28100-08f9-4c60-a5c4-1d13928ed8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.796456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e28100-08f9-4c60-a5c4-1d13928ed8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.796737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e28100-08f9-4c60-a5c4-1d13928ed8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.797418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e28100-08f9-4c60-a5c4-1d13928ed8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:09.797719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e28100-08f9-4c60-a5c4-1d13928ed8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:09.825761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e28100-08f9-4c60-a5c4-1d13928ed8a3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:09.840263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 593/1187] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:09.846087 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69849c03-9571-41ec-be31-c7fa3ba196c5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.855440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69849c03-9571-41ec-be31-c7fa3ba196c5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.859567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc66f9-aaf6-4995-a994-bd6050a0368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.860221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc66f9-aaf6-4995-a994-bd6050a0368a admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.860507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc66f9-aaf6-4995-a994-bd6050a0368a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.860786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc66f9-aaf6-4995-a994-bd6050a0368a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.869637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc66f9-aaf6-4995-a994-bd6050a0368a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:09.896035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc66f9-aaf6-4995-a994-bd6050a0368a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:09.910642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-8bcc66f9-aaf6-4995-a994-bd6050a0368a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:50:09.911776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 595/1188] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:09.917786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e28100-08f9-4c60-a5c4-1d13928ed8a3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.927416 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e28100-08f9-4c60-a5c4-1d13928ed8a3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.931483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04b9d2-3026-42cf-81f8-38043139e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.932056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b9d2-3026-42cf-81f8-38043139e5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.932337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b9d2-3026-42cf-81f8-38043139e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.932615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b9d2-3026-42cf-81f8-38043139e5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.933346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b9d2-3026-42cf-81f8-38043139e5b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:09.933645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b9d2-3026-42cf-81f8-38043139e5b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:09.959076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b9d2-3026-42cf-81f8-38043139e5b6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:09.972573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 594/1189] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:09.978507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc66f9-aaf6-4995-a994-bd6050a0368a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:09.987663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc66f9-aaf6-4995-a994-bd6050a0368a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:09.991699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8849e-07f8-4744-85c8-ac18c35b8ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:09.992504 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8849e-07f8-4744-85c8-ac18c35b8ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:09.992903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8849e-07f8-4744-85c8-ac18c35b8ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:09.993201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8849e-07f8-4744-85c8-ac18c35b8ab3 admin admin] PATH_INFO: `/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/0a678f789e3549a3b634acc510c5d0f6/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:09.994925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8849e-07f8-4744-85c8-ac18c35b8ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5033ab9f12174889a76d7c4ef0bfd997, user_id=0a678f789e3549a3b634acc510c5d0f6, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:10.021396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8849e-07f8-4744-85c8-ac18c35b8ab3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:10.113935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 596/1190] 10.222.0.87 () {58 vars in 1460 bytes} [Tue Jan 18 12:50:09 2022] PUT /identity/v3/projects/5033ab9f12174889a76d7c4ef0bfd997/users/0a678f789e3549a3b634acc510c5d0f6/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 12:50:12.233415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4a1b5-63a1-4f06-b685-7758863783e8 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.233944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4a1b5-63a1-4f06-b685-7758863783e8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.234058 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4a1b5-63a1-4f06-b685-7758863783e8 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.235695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 595/1191] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:50:12.242042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b47379-d4e4-46a0-a027-8e633dec1e3b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.242584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b47379-d4e4-46a0-a027-8e633dec1e3b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.242676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b47379-d4e4-46a0-a027-8e633dec1e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.265691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f4b47379-d4e4-46a0-a027-8e633dec1e3b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:50:12.266840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f4b47379-d4e4-46a0-a027-8e633dec1e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:50:12.339950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 597/1192] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:50:12.363509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4a1b5-63a1-4f06-b685-7758863783e8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:12.376691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4a1b5-63a1-4f06-b685-7758863783e8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:12.380719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4a4eb-7863-45cf-8c81-e61117d4f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:12.381439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4a4eb-7863-45cf-8c81-e61117d4f0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.381730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4a4eb-7863-45cf-8c81-e61117d4f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.387434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4a4eb-7863-45cf-8c81-e61117d4f0c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.394262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4a4eb-7863-45cf-8c81-e61117d4f0c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Jan 18 12:50:12.400831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-8ce4a4eb-7863-45cf-8c81-e61117d4f0c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 18 12:50:12.401954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 596/1193] 10.222.0.87 () {56 vars in 1117 bytes} [Tue Jan 18 12:50:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:12.408246 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b47379-d4e4-46a0-a027-8e633dec1e3b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:12.417075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b47379-d4e4-46a0-a027-8e633dec1e3b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:12.421299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a1382-966c-48f1-b728-482b4468d2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:12.421896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a1382-966c-48f1-b728-482b4468d2bc admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.422187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a1382-966c-48f1-b728-482b4468d2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.422468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a1382-966c-48f1-b728-482b4468d2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.423192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a1382-966c-48f1-b728-482b4468d2bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:12.423794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a1382-966c-48f1-b728-482b4468d2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:12.450445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a1382-966c-48f1-b728-482b4468d2bc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:12.459824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 598/1194] 10.222.0.87 () {56 vars in 1120 bytes} [Tue Jan 18 12:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:12.466043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4a4eb-7863-45cf-8c81-e61117d4f0c4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:12.476245 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4a4eb-7863-45cf-8c81-e61117d4f0c4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:12.480797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649580d-814f-48ec-bb46-d30453340710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:12.484901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649580d-814f-48ec-bb46-d30453340710 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.484901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649580d-814f-48ec-bb46-d30453340710 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.484901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649580d-814f-48ec-bb46-d30453340710 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.494374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649580d-814f-48ec-bb46-d30453340710 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:12.520576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649580d-814f-48ec-bb46-d30453340710 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:12.539123 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-0649580d-814f-48ec-bb46-d30453340710 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:12.544278 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 597/1195] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:12.546739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a1382-966c-48f1-b728-482b4468d2bc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:12.557498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a1382-966c-48f1-b728-482b4468d2bc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:12.561820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f242-142d-4c66-9ea6-b40bcf60783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:12.562422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f242-142d-4c66-9ea6-b40bcf60783b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.562712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f242-142d-4c66-9ea6-b40bcf60783b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.562992 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618f242-142d-4c66-9ea6-b40bcf60783b admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.563754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618f242-142d-4c66-9ea6-b40bcf60783b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:12.564075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618f242-142d-4c66-9ea6-b40bcf60783b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:12.601943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618f242-142d-4c66-9ea6-b40bcf60783b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:12.617687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 599/1196] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:12.624245 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649580d-814f-48ec-bb46-d30453340710 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:12.634687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649580d-814f-48ec-bb46-d30453340710 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:12.639207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852727af-290d-4fa2-b608-0727db71120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:12.643127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852727af-290d-4fa2-b608-0727db71120f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.643127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852727af-290d-4fa2-b608-0727db71120f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.643127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852727af-290d-4fa2-b608-0727db71120f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.654182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852727af-290d-4fa2-b608-0727db71120f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:12.681074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852727af-290d-4fa2-b608-0727db71120f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:12.701069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-852727af-290d-4fa2-b608-0727db71120f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 18 12:50:12.702239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 598/1197] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:12.709429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f242-142d-4c66-9ea6-b40bcf60783b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:12.719673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618f242-142d-4c66-9ea6-b40bcf60783b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:12.723849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee690d8-4bb1-4609-8630-f94dabffa0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:12.724503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee690d8-4bb1-4609-8630-f94dabffa0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.724793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee690d8-4bb1-4609-8630-f94dabffa0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.725079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee690d8-4bb1-4609-8630-f94dabffa0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.725872 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee690d8-4bb1-4609-8630-f94dabffa0f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:12.726176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee690d8-4bb1-4609-8630-f94dabffa0f3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:12.752312 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee690d8-4bb1-4609-8630-f94dabffa0f3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:12.785512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 600/1198] 10.222.0.87 () {56 vars in 1164 bytes} [Tue Jan 18 12:50:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:12.792330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852727af-290d-4fa2-b608-0727db71120f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:12.802128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852727af-290d-4fa2-b608-0727db71120f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:12.806581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece56a5-dfd5-4251-be75-612bf32bba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:12.807186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece56a5-dfd5-4251-be75-612bf32bba84 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.807531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece56a5-dfd5-4251-be75-612bf32bba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.807783 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece56a5-dfd5-4251-be75-612bf32bba84 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.816206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece56a5-dfd5-4251-be75-612bf32bba84 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:12.842468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece56a5-dfd5-4251-be75-612bf32bba84 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:12.853769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 599/1199] 10.222.0.87 () {58 vars in 1324 bytes} [Tue Jan 18 12:50:12 2022] GET /identity/v3/auth/tokens => generated 3413 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 12:50:12.860414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee690d8-4bb1-4609-8630-f94dabffa0f3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:12.874888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee690d8-4bb1-4609-8630-f94dabffa0f3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:12.879023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63000a3e-9f4b-449c-902b-8fbe70e342a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:12.879779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63000a3e-9f4b-449c-902b-8fbe70e342a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.880072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63000a3e-9f4b-449c-902b-8fbe70e342a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.880353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63000a3e-9f4b-449c-902b-8fbe70e342a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.892524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63000a3e-9f4b-449c-902b-8fbe70e342a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:12.919422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63000a3e-9f4b-449c-902b-8fbe70e342a0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:12.937861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-63000a3e-9f4b-449c-902b-8fbe70e342a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 18 12:50:12.939036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 601/1200] 10.222.0.87 () {56 vars in 1129 bytes} [Tue Jan 18 12:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:12.946147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece56a5-dfd5-4251-be75-612bf32bba84 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:12.955164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece56a5-dfd5-4251-be75-612bf32bba84 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:12.959433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb1ca8-36ec-4656-9731-bc1d45500355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:12.960023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb1ca8-36ec-4656-9731-bc1d45500355 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:12.960309 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb1ca8-36ec-4656-9731-bc1d45500355 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:12.960589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb1ca8-36ec-4656-9731-bc1d45500355 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:12.961274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb1ca8-36ec-4656-9731-bc1d45500355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:12.962134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb1ca8-36ec-4656-9731-bc1d45500355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:12.988076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb1ca8-36ec-4656-9731-bc1d45500355 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:13.002068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 600/1201] 10.222.0.87 () {56 vars in 1130 bytes} [Tue Jan 18 12:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:13.008047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63000a3e-9f4b-449c-902b-8fbe70e342a0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:13.017737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63000a3e-9f4b-449c-902b-8fbe70e342a0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:13.021907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb53b7-4d02-404c-ad06-af53612946a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:13.022626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb53b7-4d02-404c-ad06-af53612946a7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:13.022913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb53b7-4d02-404c-ad06-af53612946a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:13.023192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb53b7-4d02-404c-ad06-af53612946a7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:13.033239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb53b7-4d02-404c-ad06-af53612946a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:13.060457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb53b7-4d02-404c-ad06-af53612946a7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:13.076877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING keystone.server.flask.application [None req-a0cb53b7-4d02-404c-ad06-af53612946a7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 18 12:50:13.078122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 602/1202] 10.222.0.87 () {56 vars in 1132 bytes} [Tue Jan 18 12:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:13.085398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb1ca8-36ec-4656-9731-bc1d45500355 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:13.103345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb1ca8-36ec-4656-9731-bc1d45500355 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:13.108626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756fa45c-9685-4d5b-8e21-76fa5b2d21fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:13.109241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa45c-9685-4d5b-8e21-76fa5b2d21fa admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:13.109579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa45c-9685-4d5b-8e21-76fa5b2d21fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:13.109816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756fa45c-9685-4d5b-8e21-76fa5b2d21fa admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:13.110582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa45c-9685-4d5b-8e21-76fa5b2d21fa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:13.110882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa45c-9685-4d5b-8e21-76fa5b2d21fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:13.138276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756fa45c-9685-4d5b-8e21-76fa5b2d21fa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:13.152686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 601/1203] 10.222.0.87 () {56 vars in 1169 bytes} [Tue Jan 18 12:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:13.159099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb53b7-4d02-404c-ad06-af53612946a7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:13.169569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb53b7-4d02-404c-ad06-af53612946a7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:13.174144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faecb07-7291-4bcf-bc1c-b49d993ecb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:13.174729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faecb07-7291-4bcf-bc1c-b49d993ecb36 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:13.175017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faecb07-7291-4bcf-bc1c-b49d993ecb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:13.175300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faecb07-7291-4bcf-bc1c-b49d993ecb36 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:13.176103 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faecb07-7291-4bcf-bc1c-b49d993ecb36 admin admin] RBAC: Adding query filter params (role.id=585c4928fc0d4e72b6dce5e8e9f5865e, scope.project.id=5033ab9f12174889a76d7c4ef0bfd997, user.id=0a678f789e3549a3b634acc510c5d0f6) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:13.176409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faecb07-7291-4bcf-bc1c-b49d993ecb36 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:13.203226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faecb07-7291-4bcf-bc1c-b49d993ecb36 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:13.209687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 603/1204] 10.222.0.87 () {56 vars in 1395 bytes} [Tue Jan 18 12:50:13 2022] GET /identity/v3/role_assignments?user.id=0a678f789e3549a3b634acc510c5d0f6&scope.project.id=5033ab9f12174889a76d7c4ef0bfd997&role.id=585c4928fc0d4e72b6dce5e8e9f5865e => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:15.262859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fe851-778c-4d15-b3ef-7049f3b0e2fd None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:15.263449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fe851-778c-4d15-b3ef-7049f3b0e2fd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:15.263449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fe851-778c-4d15-b3ef-7049f3b0e2fd None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:15.265155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 602/1205] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:50:15.273505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10077f44-21cb-4452-b3c5-50bbcdbef44e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:15.274561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10077f44-21cb-4452-b3c5-50bbcdbef44e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:15.274561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10077f44-21cb-4452-b3c5-50bbcdbef44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:15.300201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-10077f44-21cb-4452-b3c5-50bbcdbef44e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:50:15.301461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-10077f44-21cb-4452-b3c5-50bbcdbef44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:50:15.308772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 604/1206] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:50:15 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:50:15.331507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fe851-778c-4d15-b3ef-7049f3b0e2fd None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:15.343962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fe851-778c-4d15-b3ef-7049f3b0e2fd None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:15.347802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83353ff-70a7-41b9-b919-feb4df6918a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:15.348529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83353ff-70a7-41b9-b919-feb4df6918a5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:15.348815 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83353ff-70a7-41b9-b919-feb4df6918a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:15.349093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83353ff-70a7-41b9-b919-feb4df6918a5 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:15.349715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83353ff-70a7-41b9-b919-feb4df6918a5 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:15.375733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83353ff-70a7-41b9-b919-feb4df6918a5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:15.387442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-c83353ff-70a7-41b9-b919-feb4df6918a5 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 18 12:50:15.388588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 603/1207] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:50:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:15.394805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10077f44-21cb-4452-b3c5-50bbcdbef44e None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:15.404363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10077f44-21cb-4452-b3c5-50bbcdbef44e None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:15.408742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17565d7e-2c97-4078-9c4b-4b60312c2997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:15.409332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17565d7e-2c97-4078-9c4b-4b60312c2997 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:15.409620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17565d7e-2c97-4078-9c4b-4b60312c2997 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:15.409902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17565d7e-2c97-4078-9c4b-4b60312c2997 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:15.410578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17565d7e-2c97-4078-9c4b-4b60312c2997 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:15.410909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17565d7e-2c97-4078-9c4b-4b60312c2997 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:15.444673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17565d7e-2c97-4078-9c4b-4b60312c2997 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:15.450783 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 605/1208] 10.222.0.87 () {56 vars in 1137 bytes} [Tue Jan 18 12:50:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:15.456619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83353ff-70a7-41b9-b919-feb4df6918a5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:15.467155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83353ff-70a7-41b9-b919-feb4df6918a5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:15.471517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f58a4-a45f-47bf-97cb-62f6883f0936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:15.472102 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f58a4-a45f-47bf-97cb-62f6883f0936 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:15.472386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f58a4-a45f-47bf-97cb-62f6883f0936 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:15.472662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f58a4-a45f-47bf-97cb-62f6883f0936 admin admin] PATH_INFO: `/v3/services` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:15.473329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f58a4-a45f-47bf-97cb-62f6883f0936 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:15.473621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f58a4-a45f-47bf-97cb-62f6883f0936 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:15.499432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f58a4-a45f-47bf-97cb-62f6883f0936 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:15.504808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 604/1209] 10.222.0.87 () {56 vars in 1137 bytes} [Tue Jan 18 12:50:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:17.506023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233a0f-3e3d-43d2-96ba-eab02b446c2c None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:17.506601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233a0f-3e3d-43d2-96ba-eab02b446c2c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:17.506601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45233a0f-3e3d-43d2-96ba-eab02b446c2c None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:17.508456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 606/1210] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:50:17.514926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a43e4-0118-4d45-89ae-1814308adcc4 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:17.515597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a43e4-0118-4d45-89ae-1814308adcc4 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:17.515597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a43e4-0118-4d45-89ae-1814308adcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:17.542863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-027a43e4-0118-4d45-89ae-1814308adcc4 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:50:17.544068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-027a43e4-0118-4d45-89ae-1814308adcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:50:17.551450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 605/1211] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3413 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:50:17.573774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45233a0f-3e3d-43d2-96ba-eab02b446c2c None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:17.585510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45233a0f-3e3d-43d2-96ba-eab02b446c2c None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:17.590479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d674af-72d1-4739-9358-e0cb41b49973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:17.591128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d674af-72d1-4739-9358-e0cb41b49973 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:17.591461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d674af-72d1-4739-9358-e0cb41b49973 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:17.591746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d674af-72d1-4739-9358-e0cb41b49973 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:17.592576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d674af-72d1-4739-9358-e0cb41b49973 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:17.618877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d674af-72d1-4739-9358-e0cb41b49973 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:17.721094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 607/1212] 10.222.0.87 () {60 vars in 1162 bytes} [Tue Jan 18 12:50:17 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 12:50:19.756677 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01514220-54b2-4c03-8cfe-575af4a51c8e None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:19.757242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01514220-54b2-4c03-8cfe-575af4a51c8e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:19.757242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01514220-54b2-4c03-8cfe-575af4a51c8e None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:19.760263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 606/1213] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:50:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:50:19.765530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf78246-6371-41fc-8b89-f01e78d5ba0b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:19.765960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf78246-6371-41fc-8b89-f01e78d5ba0b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:19.766093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf78246-6371-41fc-8b89-f01e78d5ba0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:19.790508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-ccf78246-6371-41fc-8b89-f01e78d5ba0b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:50:19.792179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ccf78246-6371-41fc-8b89-f01e78d5ba0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:50:19.810478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 608/1214] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:50:19 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:50:19.833712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01514220-54b2-4c03-8cfe-575af4a51c8e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:19.845471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01514220-54b2-4c03-8cfe-575af4a51c8e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:19.849565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1ad9b-e46d-45fd-b2c9-b33501328179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:19.850270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1ad9b-e46d-45fd-b2c9-b33501328179 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:19.850554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1ad9b-e46d-45fd-b2c9-b33501328179 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:19.850829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1ad9b-e46d-45fd-b2c9-b33501328179 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:19.851495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1ad9b-e46d-45fd-b2c9-b33501328179 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:19.877142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd1ad9b-e46d-45fd-b2c9-b33501328179 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:19.890042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-8fd1ad9b-e46d-45fd-b2c9-b33501328179 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 18 12:50:19.891261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 607/1215] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:50:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 18 12:50:19.897401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf78246-6371-41fc-8b89-f01e78d5ba0b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:19.907027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf78246-6371-41fc-8b89-f01e78d5ba0b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:19.911449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e450e-a00d-4db7-8f6f-44059c665b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:19.912053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e450e-a00d-4db7-8f6f-44059c665b42 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:19.912344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e450e-a00d-4db7-8f6f-44059c665b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:19.912628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e450e-a00d-4db7-8f6f-44059c665b42 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:19.913306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e450e-a00d-4db7-8f6f-44059c665b42 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:19.913610 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e450e-a00d-4db7-8f6f-44059c665b42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:19.941215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e450e-a00d-4db7-8f6f-44059c665b42 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:19.947598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 609/1216] 10.222.0.87 () {56 vars in 1137 bytes} [Tue Jan 18 12:50:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:19.953686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1ad9b-e46d-45fd-b2c9-b33501328179 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:19.963205 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd1ad9b-e46d-45fd-b2c9-b33501328179 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:19.967350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432aacf-7557-467e-a103-02db25868794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:19.967930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432aacf-7557-467e-a103-02db25868794 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:19.968217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432aacf-7557-467e-a103-02db25868794 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:19.968499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432aacf-7557-467e-a103-02db25868794 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:19.969243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432aacf-7557-467e-a103-02db25868794 admin admin] RBAC: Adding query filter params (interface=public, service_id=3e35dd7327a44c60a1fe68c41014f96e, region_id=RegionOne) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:19.969547 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432aacf-7557-467e-a103-02db25868794 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:19.995885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432aacf-7557-467e-a103-02db25868794 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:20.001516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 608/1217] 10.222.0.87 () {56 vars in 1272 bytes} [Tue Jan 18 12:50:19 2022] GET /identity/v3/endpoints?service_id=3e35dd7327a44c60a1fe68c41014f96e&interface=public®ion_id=RegionOne => generated 194 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:20.007359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e450e-a00d-4db7-8f6f-44059c665b42 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:20.016582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e450e-a00d-4db7-8f6f-44059c665b42 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:20.020672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff3c12-9e64-47eb-befb-5f96aa657ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:20.021249 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff3c12-9e64-47eb-befb-5f96aa657ade admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:20.021533 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff3c12-9e64-47eb-befb-5f96aa657ade admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:20.021809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff3c12-9e64-47eb-befb-5f96aa657ade admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:20.022441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff3c12-9e64-47eb-befb-5f96aa657ade admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:20.049648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff3c12-9e64-47eb-befb-5f96aa657ade admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:20.058247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 610/1218] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 12:50:20 2022] GET /identity/v3/services => generated 2430 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 12:50:22.050012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a255c-7648-4c9a-b952-f846322d3659 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:22.050535 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a255c-7648-4c9a-b952-f846322d3659 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:22.050622 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a255c-7648-4c9a-b952-f846322d3659 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:22.052256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 609/1219] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 12:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 12:50:22.057624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e21841-827d-44f7-8b3c-4b254c5fe82a None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:22.058120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e21841-827d-44f7-8b3c-4b254c5fe82a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:22.058224 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e21841-827d-44f7-8b3c-4b254c5fe82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:22.080758 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a6e21841-827d-44f7-8b3c-4b254c5fe82a None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 12:50:22.081935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a6e21841-827d-44f7-8b3c-4b254c5fe82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 12:50:22.089448 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 611/1220] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3516 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 12:50:22.112702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a255c-7648-4c9a-b952-f846322d3659 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:22.124364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a255c-7648-4c9a-b952-f846322d3659 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:22.128430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43821-3bfb-4a40-a995-9995fee997ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:22.129145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43821-3bfb-4a40-a995-9995fee997ca admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:22.129426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43821-3bfb-4a40-a995-9995fee997ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:22.129700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf43821-3bfb-4a40-a995-9995fee997ca admin admin] PATH_INFO: `/v3/services/placement` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:22.130311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf43821-3bfb-4a40-a995-9995fee997ca admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:22.156500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf43821-3bfb-4a40-a995-9995fee997ca admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:22.167402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING keystone.server.flask.application [None req-2cf43821-3bfb-4a40-a995-9995fee997ca admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 18 12:50:22.168505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 610/1221] 10.222.0.87 () {56 vars in 1138 bytes} [Tue Jan 18 12:50:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 18 12:50:22.174985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e21841-827d-44f7-8b3c-4b254c5fe82a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:22.183729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e21841-827d-44f7-8b3c-4b254c5fe82a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:22.187865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f51403-4c88-4693-813d-8aa4a9da3eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:22.188450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51403-4c88-4693-813d-8aa4a9da3eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:22.188733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51403-4c88-4693-813d-8aa4a9da3eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:22.189007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51403-4c88-4693-813d-8aa4a9da3eb9 admin admin] PATH_INFO: `/v3/services` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:22.189668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f51403-4c88-4693-813d-8aa4a9da3eb9 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 12:50:22.189970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f51403-4c88-4693-813d-8aa4a9da3eb9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:22.216235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f51403-4c88-4693-813d-8aa4a9da3eb9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:22.221924 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 612/1222] 10.222.0.87 () {56 vars in 1137 bytes} [Tue Jan 18 12:50:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 12:50:22.227898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43821-3bfb-4a40-a995-9995fee997ca admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 12:50:22.238214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf43821-3bfb-4a40-a995-9995fee997ca admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 12:50:22.242277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9bb69-820e-4661-8ea4-f04b5682118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 12:50:22.242901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9bb69-820e-4661-8ea4-f04b5682118d admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 12:50:22.243182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9bb69-820e-4661-8ea4-f04b5682118d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 12:50:22.243499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9bb69-820e-4661-8ea4-f04b5682118d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 12:50:22.244182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9bb69-820e-4661-8ea4-f04b5682118d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 12:50:22.269593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9bb69-820e-4661-8ea4-f04b5682118d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 12:50:22.377601 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 611/1223] 10.222.0.87 () {60 vars in 1165 bytes} [Tue Jan 18 12:50:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:00:52.960661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88712deb-c2d1-40d0-8fb5-41a2ecaf002a None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:52.961585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88712deb-c2d1-40d0-8fb5-41a2ecaf002a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:52.962023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88712deb-c2d1-40d0-8fb5-41a2ecaf002a None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:52.967503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 613/1224] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:00:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:00:52.969896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90431c3-2a2a-4999-b301-7d0727715b11 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:52.970710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90431c3-2a2a-4999-b301-7d0727715b11 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:52.970985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90431c3-2a2a-4999-b301-7d0727715b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:53.072304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f90431c3-2a2a-4999-b301-7d0727715b11 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:00:53.073662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f90431c3-2a2a-4999-b301-7d0727715b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:00:53.187703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 612/1225] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:00:53.209968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88712deb-c2d1-40d0-8fb5-41a2ecaf002a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:00:53.211668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-88712deb-c2d1-40d0-8fb5-41a2ecaf002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:00:53.366347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88712deb-c2d1-40d0-8fb5-41a2ecaf002a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:00:53.471915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92788b36-afd7-48cb-bcb9-2f4ed6f74611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:00:53.472421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92788b36-afd7-48cb-bcb9-2f4ed6f74611 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:53.472713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92788b36-afd7-48cb-bcb9-2f4ed6f74611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:53.472996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92788b36-afd7-48cb-bcb9-2f4ed6f74611 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:53.473683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92788b36-afd7-48cb-bcb9-2f4ed6f74611 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:00:53.499358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92788b36-afd7-48cb-bcb9-2f4ed6f74611 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:00:53.514383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 614/1226] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 13:00:53 2022] GET /identity/v3/projects => generated 2553 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:00:55.555850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85fa06-6d3e-4610-947b-4d45be43b9fd None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:55.556429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85fa06-6d3e-4610-947b-4d45be43b9fd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:55.556429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85fa06-6d3e-4610-947b-4d45be43b9fd None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:55.558169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 613/1227] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:00:55.563617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad5918-6173-4ef6-8f45-59965f330b25 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:55.564108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad5918-6173-4ef6-8f45-59965f330b25 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:55.564215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad5918-6173-4ef6-8f45-59965f330b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:55.653240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-42ad5918-6173-4ef6-8f45-59965f330b25 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:00:55.655700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-42ad5918-6173-4ef6-8f45-59965f330b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:00:55.764528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 615/1228] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:00:55.815204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39946b82-88ea-4e9f-ba1a-7a63672dece7 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:55.815441 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39946b82-88ea-4e9f-ba1a-7a63672dece7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:55.815730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39946b82-88ea-4e9f-ba1a-7a63672dece7 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:55.817414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 614/1229] 10.222.0.87 () {54 vars in 962 bytes} [Tue Jan 18 13:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:00:55.824170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1a001-01d5-408c-9f20-a7bb31ed27a4 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:55.824479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1a001-01d5-408c-9f20-a7bb31ed27a4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:55.824768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1a001-01d5-408c-9f20-a7bb31ed27a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:55.922723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-81d1a001-01d5-408c-9f20-a7bb31ed27a4 None None] MFA Rules not processed for user `cb93a689fc8b4aaab37c8fa4f9a08d64`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:00:55.923890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-81d1a001-01d5-408c-9f20-a7bb31ed27a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:00:56.010339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 616/1230] 10.222.0.87 () {58 vars in 1059 bytes} [Tue Jan 18 13:00:55 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:00:56.019480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39946b82-88ea-4e9f-ba1a-7a63672dece7 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:00:56.020956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-39946b82-88ea-4e9f-ba1a-7a63672dece7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:00:56.142870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39946b82-88ea-4e9f-ba1a-7a63672dece7 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:00:56.228718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85108548-5d56-4ec4-831f-32fecf0d5116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:00:56.229325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85108548-5d56-4ec4-831f-32fecf0d5116 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:56.230696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85108548-5d56-4ec4-831f-32fecf0d5116 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:56.230985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85108548-5d56-4ec4-831f-32fecf0d5116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:56.232555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-85108548-5d56-4ec4-831f-32fecf0d5116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:00:56.357588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85108548-5d56-4ec4-831f-32fecf0d5116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:00:56.385485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85108548-5d56-4ec4-831f-32fecf0d5116 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:00:56.407942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 615/1231] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:00:56 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:00:58.702860 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b60a8c-c581-4531-8053-22683ab03939 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:58.703695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b60a8c-c581-4531-8053-22683ab03939 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:58.703695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b60a8c-c581-4531-8053-22683ab03939 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:58.706840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 617/1232] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:00:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 13:00:58.715232 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973f5a1-c193-4178-9b41-9a339ff4ac71 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:58.715755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973f5a1-c193-4178-9b41-9a339ff4ac71 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:58.715871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973f5a1-c193-4178-9b41-9a339ff4ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:58.804154 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c973f5a1-c193-4178-9b41-9a339ff4ac71 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:00:58.805223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c973f5a1-c193-4178-9b41-9a339ff4ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:00:58.915943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 616/1233] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:00:58.954518 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b60a8c-c581-4531-8053-22683ab03939 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:00:58.956284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e2b60a8c-c581-4531-8053-22683ab03939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:00:59.080401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b60a8c-c581-4531-8053-22683ab03939 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:00:59.172478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae45533-ec67-459d-831f-d3a849cbe12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:00:59.173061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae45533-ec67-459d-831f-d3a849cbe12b service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:00:59.173353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae45533-ec67-459d-831f-d3a849cbe12b service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:00:59.173636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae45533-ec67-459d-831f-d3a849cbe12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:00:59.175173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-6ae45533-ec67-459d-831f-d3a849cbe12b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:00:59.298053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae45533-ec67-459d-831f-d3a849cbe12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:00:59.323500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae45533-ec67-459d-831f-d3a849cbe12b service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:00:59.344280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 618/1234] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:00:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:01.695157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c748a-5fb3-4ffc-91f6-0fd75d0f4581 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:01.695733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c748a-5fb3-4ffc-91f6-0fd75d0f4581 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:01.695842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c748a-5fb3-4ffc-91f6-0fd75d0f4581 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:01.697444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 617/1235] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:01.702824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854f94c-4e2a-4065-8431-076a1aedec01 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:01.703247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854f94c-4e2a-4065-8431-076a1aedec01 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:01.703422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854f94c-4e2a-4065-8431-076a1aedec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:01.789798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-6854f94c-4e2a-4065-8431-076a1aedec01 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:01.790973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-6854f94c-4e2a-4065-8431-076a1aedec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:01.896068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 619/1236] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:01:01.930715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c748a-5fb3-4ffc-91f6-0fd75d0f4581 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:01.932228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b55c748a-5fb3-4ffc-91f6-0fd75d0f4581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:02.081548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c748a-5fb3-4ffc-91f6-0fd75d0f4581 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:02.184708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdb089-8e69-4dfb-95e5-a1952205360b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:02.185495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdb089-8e69-4dfb-95e5-a1952205360b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:02.185782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdb089-8e69-4dfb-95e5-a1952205360b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:02.186062 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdb089-8e69-4dfb-95e5-a1952205360b admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:02.196570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdb089-8e69-4dfb-95e5-a1952205360b admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:02.222964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdb089-8e69-4dfb-95e5-a1952205360b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:02.224565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 618/1237] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:01:01 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:01:02.237444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854f94c-4e2a-4065-8431-076a1aedec01 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:02.238600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-6854f94c-4e2a-4065-8431-076a1aedec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:02.345771 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854f94c-4e2a-4065-8431-076a1aedec01 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:02.432733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb47a1c-9cc0-4ca4-8cbb-97ff034212ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:02.433307 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb47a1c-9cc0-4ca4-8cbb-97ff034212ae service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:02.433593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb47a1c-9cc0-4ca4-8cbb-97ff034212ae service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:02.433870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb47a1c-9cc0-4ca4-8cbb-97ff034212ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:02.435425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-fcb47a1c-9cc0-4ca4-8cbb-97ff034212ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:02.559095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb47a1c-9cc0-4ca4-8cbb-97ff034212ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:02.584494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb47a1c-9cc0-4ca4-8cbb-97ff034212ae service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:02.605880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 620/1238] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:05.531053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3349a5d-7edf-4d75-bc97-dcd8e6bf70e8 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:05.531627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3349a5d-7edf-4d75-bc97-dcd8e6bf70e8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:05.531627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3349a5d-7edf-4d75-bc97-dcd8e6bf70e8 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:05.533319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 619/1239] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 13:01:05.538878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19791-32dc-4964-af86-98d393e9dc43 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:05.539265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19791-32dc-4964-af86-98d393e9dc43 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:05.539469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e19791-32dc-4964-af86-98d393e9dc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:05.627549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-18e19791-32dc-4964-af86-98d393e9dc43 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:05.628853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-18e19791-32dc-4964-af86-98d393e9dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:05.736646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 621/1240] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:05.777658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3349a5d-7edf-4d75-bc97-dcd8e6bf70e8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:05.779182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e3349a5d-7edf-4d75-bc97-dcd8e6bf70e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:05.929507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3349a5d-7edf-4d75-bc97-dcd8e6bf70e8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:06.034350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f6db7-cf41-4af7-a391-34e5e33d7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:06.035140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f6db7-cf41-4af7-a391-34e5e33d7ede admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:06.035452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f6db7-cf41-4af7-a391-34e5e33d7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:06.035732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f6db7-cf41-4af7-a391-34e5e33d7ede admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:06.047069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f6db7-cf41-4af7-a391-34e5e33d7ede admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:06.073489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f6db7-cf41-4af7-a391-34e5e33d7ede admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:06.075275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 620/1241] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:01:05 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:01:06.087486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e19791-32dc-4964-af86-98d393e9dc43 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:06.089295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-18e19791-32dc-4964-af86-98d393e9dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:06.198731 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e19791-32dc-4964-af86-98d393e9dc43 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:06.282690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7da9bd-5cad-4f8f-a0e5-58577dc449de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:06.283278 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7da9bd-5cad-4f8f-a0e5-58577dc449de service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:06.283597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7da9bd-5cad-4f8f-a0e5-58577dc449de service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:06.283880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7da9bd-5cad-4f8f-a0e5-58577dc449de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:06.285413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ea7da9bd-5cad-4f8f-a0e5-58577dc449de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:06.408781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7da9bd-5cad-4f8f-a0e5-58577dc449de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:06.435478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7da9bd-5cad-4f8f-a0e5-58577dc449de service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:06.456268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 622/1242] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:09.520861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2076-44c1-4d4d-a9c2-426c60b30923 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:09.521432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2076-44c1-4d4d-a9c2-426c60b30923 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:09.521432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c2076-44c1-4d4d-a9c2-426c60b30923 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:09.523387 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 621/1243] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:09.529281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a238ee-8e2d-49fe-83be-94e816b5c4c5 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:09.529703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a238ee-8e2d-49fe-83be-94e816b5c4c5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:09.529978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a238ee-8e2d-49fe-83be-94e816b5c4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:09.621794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-74a238ee-8e2d-49fe-83be-94e816b5c4c5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:09.622965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-74a238ee-8e2d-49fe-83be-94e816b5c4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:09.730553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 623/1244] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:09.777437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e2886-9e70-46f5-a699-d96935bd3fbc None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:09.777795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e2886-9e70-46f5-a699-d96935bd3fbc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:09.778194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e2886-9e70-46f5-a699-d96935bd3fbc None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:09.780074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 622/1245] 10.222.0.87 () {54 vars in 962 bytes} [Tue Jan 18 13:01:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:09.786916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e55f71-9174-4440-ab5e-576e04585425 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:09.787240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e55f71-9174-4440-ab5e-576e04585425 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:09.787562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e55f71-9174-4440-ab5e-576e04585425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:09.900892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-69e55f71-9174-4440-ab5e-576e04585425 None None] MFA Rules not processed for user `cb93a689fc8b4aaab37c8fa4f9a08d64`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:09.902156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-69e55f71-9174-4440-ab5e-576e04585425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:09.998970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 624/1246] 10.222.0.87 () {58 vars in 1059 bytes} [Tue Jan 18 13:01:09 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:10.007944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e2886-9e70-46f5-a699-d96935bd3fbc None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:10.009455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-353e2886-9e70-46f5-a699-d96935bd3fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:10.140597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e2886-9e70-46f5-a699-d96935bd3fbc None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:10.231131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a96969-72f4-434b-8d5d-352766d24cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:10.231668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a96969-72f4-434b-8d5d-352766d24cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:10.231958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a96969-72f4-434b-8d5d-352766d24cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:10.232240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a96969-72f4-434b-8d5d-352766d24cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:10.233775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f1a96969-72f4-434b-8d5d-352766d24cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:10.360525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a96969-72f4-434b-8d5d-352766d24cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:10.387127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a96969-72f4-434b-8d5d-352766d24cb6 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:10.408896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 623/1247] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:10 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:12.741148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f34e6-5bb6-4a73-8c14-6346d141121d None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:12.741744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f34e6-5bb6-4a73-8c14-6346d141121d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:12.741744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f34e6-5bb6-4a73-8c14-6346d141121d None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:12.743443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 625/1248] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:12.750124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ba81-2aaf-4115-a023-7e9426bc9136 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:12.750692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ba81-2aaf-4115-a023-7e9426bc9136 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:12.750692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ba81-2aaf-4115-a023-7e9426bc9136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:12.851867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-db27ba81-2aaf-4115-a023-7e9426bc9136 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:12.853034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-db27ba81-2aaf-4115-a023-7e9426bc9136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:12.970887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 624/1249] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:13.002436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f34e6-5bb6-4a73-8c14-6346d141121d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:13.003929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-375f34e6-5bb6-4a73-8c14-6346d141121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:13.150131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f34e6-5bb6-4a73-8c14-6346d141121d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:13.248539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975815f3-a807-4cdd-93cb-f8bb9bd92321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:13.249488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975815f3-a807-4cdd-93cb-f8bb9bd92321 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:13.249488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975815f3-a807-4cdd-93cb-f8bb9bd92321 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:13.249674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975815f3-a807-4cdd-93cb-f8bb9bd92321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:13.251217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-975815f3-a807-4cdd-93cb-f8bb9bd92321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:13.380677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975815f3-a807-4cdd-93cb-f8bb9bd92321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:13.408114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975815f3-a807-4cdd-93cb-f8bb9bd92321 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:13.437347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 626/1250] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:15.714424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35790727-03cb-4447-8a80-a707b83bfa77 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:15.714941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35790727-03cb-4447-8a80-a707b83bfa77 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:15.714941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35790727-03cb-4447-8a80-a707b83bfa77 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:15.716618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 625/1251] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:15.722194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e1b28-6d3d-44e7-b6f8-4baa9a3fd46d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:15.722840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e1b28-6d3d-44e7-b6f8-4baa9a3fd46d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:15.722840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e1b28-6d3d-44e7-b6f8-4baa9a3fd46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:15.807879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-650e1b28-6d3d-44e7-b6f8-4baa9a3fd46d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:15.809015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-650e1b28-6d3d-44e7-b6f8-4baa9a3fd46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:15.998516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 627/1252] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:16.030980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35790727-03cb-4447-8a80-a707b83bfa77 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:16.032497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-35790727-03cb-4447-8a80-a707b83bfa77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:16.176028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35790727-03cb-4447-8a80-a707b83bfa77 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:16.280162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3de971-ea86-4581-897b-fb67ad4d4fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:16.280858 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de971-ea86-4581-897b-fb67ad4d4fcf admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:16.281149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de971-ea86-4581-897b-fb67ad4d4fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:16.281432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3de971-ea86-4581-897b-fb67ad4d4fcf admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:16.292994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3de971-ea86-4581-897b-fb67ad4d4fcf admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:16.318754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3de971-ea86-4581-897b-fb67ad4d4fcf admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:16.320409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 626/1253] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:01:16 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:01:16.332172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e1b28-6d3d-44e7-b6f8-4baa9a3fd46d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:16.333369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-650e1b28-6d3d-44e7-b6f8-4baa9a3fd46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:16.438043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e1b28-6d3d-44e7-b6f8-4baa9a3fd46d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:16.531954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b50c37-c018-4017-b307-0a55bdf7939a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:16.532455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b50c37-c018-4017-b307-0a55bdf7939a service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:16.532744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b50c37-c018-4017-b307-0a55bdf7939a service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:16.533025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b50c37-c018-4017-b307-0a55bdf7939a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:16.534578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-93b50c37-c018-4017-b307-0a55bdf7939a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:16.662156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b50c37-c018-4017-b307-0a55bdf7939a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:16.688470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b50c37-c018-4017-b307-0a55bdf7939a service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:16.716213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 628/1254] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:16 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:19.347001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfe1e9-f730-4d32-a1bf-4a27fe14d81f None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:19.347584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfe1e9-f730-4d32-a1bf-4a27fe14d81f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:19.347584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfe1e9-f730-4d32-a1bf-4a27fe14d81f None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:19.349290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 627/1255] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:19.354714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce38bc8-9d1c-4db1-896d-cadc14c50ea6 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:19.355251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce38bc8-9d1c-4db1-896d-cadc14c50ea6 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:19.355375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce38bc8-9d1c-4db1-896d-cadc14c50ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:19.446687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-fce38bc8-9d1c-4db1-896d-cadc14c50ea6 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:19.448664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-fce38bc8-9d1c-4db1-896d-cadc14c50ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:19.556593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 629/1256] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:19.599677 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfe1e9-f730-4d32-a1bf-4a27fe14d81f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:19.601134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d1bfe1e9-f730-4d32-a1bf-4a27fe14d81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:19.730557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfe1e9-f730-4d32-a1bf-4a27fe14d81f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:19.817390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8865de66-a8c6-4896-a1f9-5bdcfd9c2f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:19.817882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865de66-a8c6-4896-a1f9-5bdcfd9c2f00 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:19.818168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865de66-a8c6-4896-a1f9-5bdcfd9c2f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:19.818444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865de66-a8c6-4896-a1f9-5bdcfd9c2f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:19.820013 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8865de66-a8c6-4896-a1f9-5bdcfd9c2f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:19.954152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865de66-a8c6-4896-a1f9-5bdcfd9c2f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:19.981023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8865de66-a8c6-4896-a1f9-5bdcfd9c2f00 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:20.002825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 628/1257] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:19 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:22.078077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb5a33-8b59-4531-81f3-fcb3bfd153a8 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:22.078633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb5a33-8b59-4531-81f3-fcb3bfd153a8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:22.078633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb5a33-8b59-4531-81f3-fcb3bfd153a8 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:22.080526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 630/1258] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:22.085551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea9c6-017b-4e49-b4c9-5dea8310472d None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:22.085952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea9c6-017b-4e49-b4c9-5dea8310472d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:22.086241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea9c6-017b-4e49-b4c9-5dea8310472d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:22.255464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ed6ea9c6-017b-4e49-b4c9-5dea8310472d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:22.256601 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ed6ea9c6-017b-4e49-b4c9-5dea8310472d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:22.372566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 629/1259] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:22.413787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb5a33-8b59-4531-81f3-fcb3bfd153a8 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:22.415242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ddfb5a33-8b59-4531-81f3-fcb3bfd153a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:22.540760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb5a33-8b59-4531-81f3-fcb3bfd153a8 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:22.626170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea4a2-3283-45a3-bc0a-8de9eb5b4dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:22.626671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea4a2-3283-45a3-bc0a-8de9eb5b4dce service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:22.626960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea4a2-3283-45a3-bc0a-8de9eb5b4dce service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:22.627298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea4a2-3283-45a3-bc0a-8de9eb5b4dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:22.628868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-740ea4a2-3283-45a3-bc0a-8de9eb5b4dce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:22.768786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea4a2-3283-45a3-bc0a-8de9eb5b4dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:22.799530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea4a2-3283-45a3-bc0a-8de9eb5b4dce service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:22.821174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 631/1260] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:22 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:01:25.709867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0cf3-6cce-45c2-a676-d6b67eadca56 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:25.710406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0cf3-6cce-45c2-a676-d6b67eadca56 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:25.710406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0cf3-6cce-45c2-a676-d6b67eadca56 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:25.712142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 630/1261] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:25.718302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76445a2-d199-40f2-be52-d037be7a5a60 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:25.718865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76445a2-d199-40f2-be52-d037be7a5a60 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:25.718865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76445a2-d199-40f2-be52-d037be7a5a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:25.817322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d76445a2-d199-40f2-be52-d037be7a5a60 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:25.818459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d76445a2-d199-40f2-be52-d037be7a5a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:25.939375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 632/1262] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:25.986787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e0cf3-6cce-45c2-a676-d6b67eadca56 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:25.989184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4a5e0cf3-6cce-45c2-a676-d6b67eadca56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:26.112298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e0cf3-6cce-45c2-a676-d6b67eadca56 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:26.115662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b17fe-24d4-4c16-ac7b-da4685e385a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:26.116255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b17fe-24d4-4c16-ac7b-da4685e385a1 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:26.116538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b17fe-24d4-4c16-ac7b-da4685e385a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:26.116816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b17fe-24d4-4c16-ac7b-da4685e385a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:26.127074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b17fe-24d4-4c16-ac7b-da4685e385a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:26.153070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b17fe-24d4-4c16-ac7b-da4685e385a1 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:26.163025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 631/1263] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:25 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:31.114069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f81f08-3a41-4592-8b62-ba4c53fd2f39 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:31.115157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f81f08-3a41-4592-8b62-ba4c53fd2f39 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:31.115423 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f81f08-3a41-4592-8b62-ba4c53fd2f39 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:31.117392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 633/1264] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:31.123998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66f3a5-1ed7-4519-8a6b-fbacb5c929c0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:31.124743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66f3a5-1ed7-4519-8a6b-fbacb5c929c0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:31.124743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66f3a5-1ed7-4519-8a6b-fbacb5c929c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:31.147266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-2a66f3a5-1ed7-4519-8a6b-fbacb5c929c0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:31.148456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-2a66f3a5-1ed7-4519-8a6b-fbacb5c929c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:31.157427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 632/1265] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:31.196811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f81f08-3a41-4592-8b62-ba4c53fd2f39 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:31.207718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f81f08-3a41-4592-8b62-ba4c53fd2f39 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:31.211066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcff7e2-dafd-45cd-a480-45761eccf88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:31.211671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff7e2-dafd-45cd-a480-45761eccf88c service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:31.213500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff7e2-dafd-45cd-a480-45761eccf88c service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:31.213783 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcff7e2-dafd-45cd-a480-45761eccf88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:31.224188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcff7e2-dafd-45cd-a480-45761eccf88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:31.249894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcff7e2-dafd-45cd-a480-45761eccf88c service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:31.259816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 634/1266] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:34.606273 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dedcce-4b2a-4bfe-8e9c-5b4f6dfe784a None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:34.606905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dedcce-4b2a-4bfe-8e9c-5b4f6dfe784a None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:34.606905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dedcce-4b2a-4bfe-8e9c-5b4f6dfe784a None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:34.608686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 633/1267] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:34.615170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a44a5-bcfb-4741-af34-f85d2cccc51b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:34.615804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a44a5-bcfb-4741-af34-f85d2cccc51b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:34.615804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a44a5-bcfb-4741-af34-f85d2cccc51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:34.640105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-759a44a5-bcfb-4741-af34-f85d2cccc51b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:34.641290 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-759a44a5-bcfb-4741-af34-f85d2cccc51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:34.648933 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 635/1268] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:34.690095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dedcce-4b2a-4bfe-8e9c-5b4f6dfe784a None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:34.703052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dedcce-4b2a-4bfe-8e9c-5b4f6dfe784a None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:34.706813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd260f9-efc9-4de1-a003-90c68a71f248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:34.707542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd260f9-efc9-4de1-a003-90c68a71f248 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:34.707910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd260f9-efc9-4de1-a003-90c68a71f248 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:34.708265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd260f9-efc9-4de1-a003-90c68a71f248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:34.718015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd260f9-efc9-4de1-a003-90c68a71f248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:34.745106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd260f9-efc9-4de1-a003-90c68a71f248 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:34.755453 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 634/1269] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:39.984030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af4af-faf1-422c-a869-0c37fdd13c08 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:39.984576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af4af-faf1-422c-a869-0c37fdd13c08 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:39.984576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af4af-faf1-422c-a869-0c37fdd13c08 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:39.986491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 636/1270] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:39.995382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb621-37c9-4b17-a8fa-84398919b8f5 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:39.995920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb621-37c9-4b17-a8fa-84398919b8f5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:39.996040 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfb621-37c9-4b17-a8fa-84398919b8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:40.034184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f7bfb621-37c9-4b17-a8fa-84398919b8f5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:40.036142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f7bfb621-37c9-4b17-a8fa-84398919b8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:40.053947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 635/1271] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:40.101487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676af4af-faf1-422c-a869-0c37fdd13c08 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:40.114141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676af4af-faf1-422c-a869-0c37fdd13c08 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:40.118109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a08e11-232f-4e1c-8854-e7d374f8bc03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:40.119534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a08e11-232f-4e1c-8854-e7d374f8bc03 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:40.120483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a08e11-232f-4e1c-8854-e7d374f8bc03 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:40.120837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a08e11-232f-4e1c-8854-e7d374f8bc03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:40.131645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a08e11-232f-4e1c-8854-e7d374f8bc03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:40.159614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a08e11-232f-4e1c-8854-e7d374f8bc03 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:40.173790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 637/1272] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:01:45.340149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818fb4e-917a-4126-885e-c5eb80a8d0b5 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:45.340736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818fb4e-917a-4126-885e-c5eb80a8d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:45.341175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818fb4e-917a-4126-885e-c5eb80a8d0b5 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:45.343680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 636/1273] 10.222.0.87 () {54 vars in 921 bytes} [Tue Jan 18 13:01:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:45.351594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0b4c3-ed8d-49c3-807c-f740e469a6f1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:45.352148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0b4c3-ed8d-49c3-807c-f740e469a6f1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:45.352148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0b4c3-ed8d-49c3-807c-f740e469a6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:45.476403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c8b0b4c3-ed8d-49c3-807c-f740e469a6f1 None None] MFA Rules not processed for user `0a678f789e3549a3b634acc510c5d0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:45.477724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c8b0b4c3-ed8d-49c3-807c-f740e469a6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:45.614276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 638/1274] 10.222.0.87 () {58 vars in 1018 bytes} [Tue Jan 18 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:45.990342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe148e-e4aa-472b-8f0a-3fab282d47d1 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:45.990634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe148e-e4aa-472b-8f0a-3fab282d47d1 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:45.992777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe148e-e4aa-472b-8f0a-3fab282d47d1 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:45.993015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 637/1275] 10.222.0.87 () {54 vars in 921 bytes} [Tue Jan 18 13:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:46.000239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ab493-9e2d-41cb-bea0-d2bf359ee59b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:46.000239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ab493-9e2d-41cb-bea0-d2bf359ee59b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:46.007359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ab493-9e2d-41cb-bea0-d2bf359ee59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:46.086805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-8c9ab493-9e2d-41cb-bea0-d2bf359ee59b None None] MFA Rules not processed for user `0a678f789e3549a3b634acc510c5d0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:46.089616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-8c9ab493-9e2d-41cb-bea0-d2bf359ee59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:46.105513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 639/1276] 10.222.0.87 () {58 vars in 1018 bytes} [Tue Jan 18 13:01:45 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:50.277071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24193d39-ec17-4a81-8df1-b0fa0b6428dc None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:50.277596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24193d39-ec17-4a81-8df1-b0fa0b6428dc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:50.277705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24193d39-ec17-4a81-8df1-b0fa0b6428dc None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:50.279637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 638/1277] 10.222.0.87 () {54 vars in 921 bytes} [Tue Jan 18 13:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:50.284745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b17c-8765-4b53-be54-0115d3716ab1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:50.285279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b17c-8765-4b53-be54-0115d3716ab1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:50.285279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a1b17c-8765-4b53-be54-0115d3716ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:50.309558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-89a1b17c-8765-4b53-be54-0115d3716ab1 None None] MFA Rules not processed for user `0a678f789e3549a3b634acc510c5d0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:50.310695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-89a1b17c-8765-4b53-be54-0115d3716ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:50.319441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 640/1278] 10.222.0.87 () {58 vars in 1018 bytes} [Tue Jan 18 13:01:50 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:51.913953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678b2e0-c3f6-4b47-a9cf-ef8d85cfa720 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:51.914467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678b2e0-c3f6-4b47-a9cf-ef8d85cfa720 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:51.914592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678b2e0-c3f6-4b47-a9cf-ef8d85cfa720 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:51.917051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 639/1279] 10.222.0.87 () {54 vars in 921 bytes} [Tue Jan 18 13:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:51.922002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628781-def6-4cd9-aad3-9698da4ed9d7 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:51.922431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628781-def6-4cd9-aad3-9698da4ed9d7 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:51.922568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628781-def6-4cd9-aad3-9698da4ed9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:51.945342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a6628781-def6-4cd9-aad3-9698da4ed9d7 None None] MFA Rules not processed for user `0a678f789e3549a3b634acc510c5d0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:51.946499 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a6628781-def6-4cd9-aad3-9698da4ed9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:51.954280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 641/1280] 10.222.0.87 () {58 vars in 1018 bytes} [Tue Jan 18 13:01:51 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:55.297025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5df44-8033-4d0b-bb1c-742ef72051f7 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:55.297548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5df44-8033-4d0b-bb1c-742ef72051f7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:55.297548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5df44-8033-4d0b-bb1c-742ef72051f7 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:55.299223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 640/1281] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:55.304417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87588150-66da-48f0-9a09-29051c4f0f68 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:55.304845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87588150-66da-48f0-9a09-29051c4f0f68 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:55.304967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87588150-66da-48f0-9a09-29051c4f0f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:55.328000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-87588150-66da-48f0-9a09-29051c4f0f68 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:55.329164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-87588150-66da-48f0-9a09-29051c4f0f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:55.335981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 642/1282] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:55.426985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c5ff-64df-4d1e-872d-5aabc64053bc None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:55.427399 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c5ff-64df-4d1e-872d-5aabc64053bc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:55.427684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967c5ff-64df-4d1e-872d-5aabc64053bc None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:55.429358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 641/1283] 10.222.0.87 () {54 vars in 959 bytes} [Tue Jan 18 13:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 13:01:55.435472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a060-e320-408f-9590-6731ce401ba6 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:55.435841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a060-e320-408f-9590-6731ce401ba6 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:55.436065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8a060-e320-408f-9590-6731ce401ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:55.505832 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-68a8a060-e320-408f-9590-6731ce401ba6 None None] MFA Rules not processed for user `394a96c082ed47bbbd645b489a4ed208`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:55.506995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-68a8a060-e320-408f-9590-6731ce401ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:55.597701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 643/1284] 10.222.0.87 () {58 vars in 1056 bytes} [Tue Jan 18 13:01:55 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:55.605866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c5ff-64df-4d1e-872d-5aabc64053bc None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:55.619569 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967c5ff-64df-4d1e-872d-5aabc64053bc None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:55.624741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b10ec-ef47-4063-a046-f7d500ec0948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:55.625311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b10ec-ef47-4063-a046-f7d500ec0948 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:55.625596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b10ec-ef47-4063-a046-f7d500ec0948 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:55.625874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b10ec-ef47-4063-a046-f7d500ec0948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:55.634725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b10ec-ef47-4063-a046-f7d500ec0948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:55.660977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b10ec-ef47-4063-a046-f7d500ec0948 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:55.670694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 642/1285] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:01:57.871513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c1832-7517-45e3-b363-c03926bce68c None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:57.872431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c1832-7517-45e3-b363-c03926bce68c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:57.872431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c1832-7517-45e3-b363-c03926bce68c None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:57.874297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 644/1286] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:57.880220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3741-c115-4915-a15f-a33b1f1accf0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:57.880823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3741-c115-4915-a15f-a33b1f1accf0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:57.880823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b3741-c115-4915-a15f-a33b1f1accf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:57.904776 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b84b3741-c115-4915-a15f-a33b1f1accf0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:57.905941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b84b3741-c115-4915-a15f-a33b1f1accf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:57.913381 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 643/1287] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:01:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:58.008683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd74e-cd06-445c-b341-bded58025140 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:58.008683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd74e-cd06-445c-b341-bded58025140 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:58.009355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dd74e-cd06-445c-b341-bded58025140 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:58.011048 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 645/1288] 10.222.0.87 () {54 vars in 959 bytes} [Tue Jan 18 13:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:01:58.017285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857cc9-a1ba-4189-b3c9-5ed8296ad4f2 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:58.017574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857cc9-a1ba-4189-b3c9-5ed8296ad4f2 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:58.017894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c857cc9-a1ba-4189-b3c9-5ed8296ad4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:58.043722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-9c857cc9-a1ba-4189-b3c9-5ed8296ad4f2 None None] MFA Rules not processed for user `394a96c082ed47bbbd645b489a4ed208`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:01:58.044888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9c857cc9-a1ba-4189-b3c9-5ed8296ad4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:01:58.053412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 644/1289] 10.222.0.87 () {58 vars in 1056 bytes} [Tue Jan 18 13:01:58 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:01:58.062058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd74e-cd06-445c-b341-bded58025140 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:01:58.076605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dd74e-cd06-445c-b341-bded58025140 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:01:58.081684 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e734f9c-1dc9-413f-9312-561ad286b1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:01:58.082270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e734f9c-1dc9-413f-9312-561ad286b1f6 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:01:58.082556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e734f9c-1dc9-413f-9312-561ad286b1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:01:58.082839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e734f9c-1dc9-413f-9312-561ad286b1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:01:58.092163 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e734f9c-1dc9-413f-9312-561ad286b1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:01:58.119203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e734f9c-1dc9-413f-9312-561ad286b1f6 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:01:58.129260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 646/1290] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:01:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:00.619985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488f6db-7323-4ece-8e07-9ad5fec3223f None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:00.620537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488f6db-7323-4ece-8e07-9ad5fec3223f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:00.620537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488f6db-7323-4ece-8e07-9ad5fec3223f None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:00.622260 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 645/1291] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:00.628237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7145585-e158-4c72-9ec3-946edff7b20b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:00.628815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7145585-e158-4c72-9ec3-946edff7b20b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:00.628815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7145585-e158-4c72-9ec3-946edff7b20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:00.652543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a7145585-e158-4c72-9ec3-946edff7b20b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:00.653714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a7145585-e158-4c72-9ec3-946edff7b20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:00.660974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 647/1292] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:00.750463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488f6db-7323-4ece-8e07-9ad5fec3223f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:00.764528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488f6db-7323-4ece-8e07-9ad5fec3223f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:00.769642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a50fb-8368-442b-9129-dbfb6fa59c10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:00.770230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a50fb-8368-442b-9129-dbfb6fa59c10 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:00.770512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a50fb-8368-442b-9129-dbfb6fa59c10 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:00.770792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a50fb-8368-442b-9129-dbfb6fa59c10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:00.779842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a50fb-8368-442b-9129-dbfb6fa59c10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:00.806849 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a50fb-8368-442b-9129-dbfb6fa59c10 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:00.817433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 646/1293] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:03.362538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0b818-28b8-4cd9-8292-bf616afcdd2c None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:03.363049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0b818-28b8-4cd9-8292-bf616afcdd2c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:03.363049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0b818-28b8-4cd9-8292-bf616afcdd2c None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:03.364724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 648/1294] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:03.370569 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd72b-7ea0-49c7-a84c-d3fe34b7f76e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:03.370984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd72b-7ea0-49c7-a84c-d3fe34b7f76e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:03.371148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbd72b-7ea0-49c7-a84c-d3fe34b7f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:03.394170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-84fbd72b-7ea0-49c7-a84c-d3fe34b7f76e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:03.395330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-84fbd72b-7ea0-49c7-a84c-d3fe34b7f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:03.402251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 647/1295] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:03.489226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0b818-28b8-4cd9-8292-bf616afcdd2c None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:03.503246 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0b818-28b8-4cd9-8292-bf616afcdd2c None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:03.508203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51e1b6-1067-488c-a0f3-a9f61c27d3e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:03.509379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51e1b6-1067-488c-a0f3-a9f61c27d3e7 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:03.509662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51e1b6-1067-488c-a0f3-a9f61c27d3e7 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:03.509996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51e1b6-1067-488c-a0f3-a9f61c27d3e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:03.521557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51e1b6-1067-488c-a0f3-a9f61c27d3e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:03.549962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51e1b6-1067-488c-a0f3-a9f61c27d3e7 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:03.560719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 649/1296] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:03 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:05.966771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f9ac-cc44-4b9f-bb3a-28808f6e2a09 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:05.967335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f9ac-cc44-4b9f-bb3a-28808f6e2a09 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:05.967335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934f9ac-cc44-4b9f-bb3a-28808f6e2a09 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:05.969022 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 648/1297] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:05.974211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967973e-4caf-4265-9999-aa49b682f361 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:05.974629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967973e-4caf-4265-9999-aa49b682f361 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:05.974784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9967973e-4caf-4265-9999-aa49b682f361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:06.000008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-9967973e-4caf-4265-9999-aa49b682f361 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:06.001148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-9967973e-4caf-4265-9999-aa49b682f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:06.008492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 650/1298] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:06.096747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f9ac-cc44-4b9f-bb3a-28808f6e2a09 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:06.111456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934f9ac-cc44-4b9f-bb3a-28808f6e2a09 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:06.116571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b586-0ac9-496a-bd71-2d32d9229592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:06.117160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b586-0ac9-496a-bd71-2d32d9229592 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:06.117449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b586-0ac9-496a-bd71-2d32d9229592 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:06.117729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b586-0ac9-496a-bd71-2d32d9229592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:06.127858 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669b586-0ac9-496a-bd71-2d32d9229592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:06.154472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669b586-0ac9-496a-bd71-2d32d9229592 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:06.164571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 649/1299] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:02:08.380966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d13263-035f-4158-8899-9211750c3e8a None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:08.381501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d13263-035f-4158-8899-9211750c3e8a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:08.381501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d13263-035f-4158-8899-9211750c3e8a None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:08.383185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 651/1300] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:08.388580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c0f36-9f63-40ff-902c-e07810c3cff7 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:08.389013 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c0f36-9f63-40ff-902c-e07810c3cff7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:08.389148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c0f36-9f63-40ff-902c-e07810c3cff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:08.411477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1b6c0f36-9f63-40ff-902c-e07810c3cff7 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:08.412646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1b6c0f36-9f63-40ff-902c-e07810c3cff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:08.420437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 650/1301] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:08.507282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d13263-035f-4158-8899-9211750c3e8a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:08.521559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d13263-035f-4158-8899-9211750c3e8a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:08.527938 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe27ef-d74e-4f4b-90bf-daca290d6696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:08.528510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe27ef-d74e-4f4b-90bf-daca290d6696 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:08.528798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe27ef-d74e-4f4b-90bf-daca290d6696 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:08.529081 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe27ef-d74e-4f4b-90bf-daca290d6696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:08.537143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe27ef-d74e-4f4b-90bf-daca290d6696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:08.562898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe27ef-d74e-4f4b-90bf-daca290d6696 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:08.573768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 652/1302] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:10.829428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063a8fb-3ef3-428a-941e-6c052697db3a None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:10.829965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063a8fb-3ef3-428a-941e-6c052697db3a None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:10.829965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063a8fb-3ef3-428a-941e-6c052697db3a None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:10.831749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 651/1303] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:10.837667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2622c-360d-4769-9793-f6befe8803d7 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:10.838084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2622c-360d-4769-9793-f6befe8803d7 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:10.838240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2622c-360d-4769-9793-f6befe8803d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:10.860564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-dba2622c-360d-4769-9793-f6befe8803d7 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:10.861703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-dba2622c-360d-4769-9793-f6befe8803d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:10.869394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 653/1304] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:10.954452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063a8fb-3ef3-428a-941e-6c052697db3a None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:10.969334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063a8fb-3ef3-428a-941e-6c052697db3a None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:10.974304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b6b3d-0d48-47af-a9ef-c0a3103af012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:10.974883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b6b3d-0d48-47af-a9ef-c0a3103af012 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:10.975176 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b6b3d-0d48-47af-a9ef-c0a3103af012 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:10.975488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b6b3d-0d48-47af-a9ef-c0a3103af012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:10.984760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b6b3d-0d48-47af-a9ef-c0a3103af012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:11.011351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b6b3d-0d48-47af-a9ef-c0a3103af012 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:11.021255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 652/1305] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:10 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:02:13.033793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebf9e3-92e4-46d0-bd47-caf60dd13ffa None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:13.034387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebf9e3-92e4-46d0-bd47-caf60dd13ffa None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:13.034387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebf9e3-92e4-46d0-bd47-caf60dd13ffa None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:13.036099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 654/1306] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:13.041876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f3922-611f-4389-b606-f11ba3e5dc85 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:13.042323 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f3922-611f-4389-b606-f11ba3e5dc85 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:13.042456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9f3922-611f-4389-b606-f11ba3e5dc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:13.065628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ad9f3922-611f-4389-b606-f11ba3e5dc85 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:13.066916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ad9f3922-611f-4389-b606-f11ba3e5dc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:13.074716 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 653/1307] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:02:13.165268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebf9e3-92e4-46d0-bd47-caf60dd13ffa None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:13.178526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebf9e3-92e4-46d0-bd47-caf60dd13ffa None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:13.184320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2d88f-6633-4016-ae64-c49cc4688555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:13.184893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d88f-6633-4016-ae64-c49cc4688555 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:13.185181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d88f-6633-4016-ae64-c49cc4688555 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:13.185461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d88f-6633-4016-ae64-c49cc4688555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:13.193323 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d88f-6633-4016-ae64-c49cc4688555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:13.219594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d88f-6633-4016-ae64-c49cc4688555 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:13.229064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 655/1308] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:15.547093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c2b5-63db-49f2-afd3-256116584fd0 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:15.547679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c2b5-63db-49f2-afd3-256116584fd0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:15.547679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18c2b5-63db-49f2-afd3-256116584fd0 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:15.549348 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 654/1309] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:15.555548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696740-a3da-4042-9dcf-062861e9abfa None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:15.556207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696740-a3da-4042-9dcf-062861e9abfa None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:15.556207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9696740-a3da-4042-9dcf-062861e9abfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:15.580254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c9696740-a3da-4042-9dcf-062861e9abfa None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:15.581408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c9696740-a3da-4042-9dcf-062861e9abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:15.588551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 656/1310] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:15.681135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c2b5-63db-49f2-afd3-256116584fd0 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:15.693954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18c2b5-63db-49f2-afd3-256116584fd0 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:15.699493 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c688-3465-429b-acf2-7d2dd01b6b8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:15.700060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c688-3465-429b-acf2-7d2dd01b6b8e service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:15.700347 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c688-3465-429b-acf2-7d2dd01b6b8e service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:15.700626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c688-3465-429b-acf2-7d2dd01b6b8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:15.708632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0c688-3465-429b-acf2-7d2dd01b6b8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:15.734136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0c688-3465-429b-acf2-7d2dd01b6b8e service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:15.743991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 655/1311] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:18.201831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ee00-999d-4c03-98e4-1aca7176f385 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:18.202397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ee00-999d-4c03-98e4-1aca7176f385 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:18.202397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ee00-999d-4c03-98e4-1aca7176f385 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:18.204119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 657/1312] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:18.209337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d80893-ed61-4a6a-9dd3-ae31987424c5 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:18.209827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d80893-ed61-4a6a-9dd3-ae31987424c5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:18.209945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d80893-ed61-4a6a-9dd3-ae31987424c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:18.232944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-92d80893-ed61-4a6a-9dd3-ae31987424c5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:18.234108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-92d80893-ed61-4a6a-9dd3-ae31987424c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:18.241090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 656/1313] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:18.330054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711ee00-999d-4c03-98e4-1aca7176f385 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:18.344639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711ee00-999d-4c03-98e4-1aca7176f385 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:18.349575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be72c8-80ed-4c84-a9ca-643f75b39b15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:18.350139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be72c8-80ed-4c84-a9ca-643f75b39b15 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:18.350432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be72c8-80ed-4c84-a9ca-643f75b39b15 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:18.350718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be72c8-80ed-4c84-a9ca-643f75b39b15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:18.359335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be72c8-80ed-4c84-a9ca-643f75b39b15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:18.386209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be72c8-80ed-4c84-a9ca-643f75b39b15 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:18.395650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 658/1314] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:18 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:20.653592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f8b8-fded-4d17-974c-bf03da27ceb0 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:20.654159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f8b8-fded-4d17-974c-bf03da27ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:20.654159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f72f8b8-fded-4d17-974c-bf03da27ceb0 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:20.655844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 657/1315] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:20.661137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c8595-a335-4913-b526-317110afc92e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:20.661551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c8595-a335-4913-b526-317110afc92e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:20.661704 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c8595-a335-4913-b526-317110afc92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:20.684691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-619c8595-a335-4913-b526-317110afc92e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:20.685813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-619c8595-a335-4913-b526-317110afc92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:20.692639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 659/1316] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:20.780709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72f8b8-fded-4d17-974c-bf03da27ceb0 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:20.794554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f72f8b8-fded-4d17-974c-bf03da27ceb0 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:20.799467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33c926-ab76-4c59-a995-8fd2b1544552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:20.800035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c926-ab76-4c59-a995-8fd2b1544552 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:20.800322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c926-ab76-4c59-a995-8fd2b1544552 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:20.800604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33c926-ab76-4c59-a995-8fd2b1544552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:20.808982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c926-ab76-4c59-a995-8fd2b1544552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:20.835197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33c926-ab76-4c59-a995-8fd2b1544552 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:20.845190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 658/1317] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:23.168356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3637e0-1a4c-4c0c-9c2a-4c4f5fa657bb None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:23.168906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3637e0-1a4c-4c0c-9c2a-4c4f5fa657bb None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:23.168906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3637e0-1a4c-4c0c-9c2a-4c4f5fa657bb None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:23.170656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 660/1318] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:23.175940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d53c-cdf0-43c0-abb5-e14a798c5495 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:23.176384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d53c-cdf0-43c0-abb5-e14a798c5495 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:23.176516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04d53c-cdf0-43c0-abb5-e14a798c5495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:23.199536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-9f04d53c-cdf0-43c0-abb5-e14a798c5495 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:23.200679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9f04d53c-cdf0-43c0-abb5-e14a798c5495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:23.207807 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 659/1319] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:23.294412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3637e0-1a4c-4c0c-9c2a-4c4f5fa657bb None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:23.308652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3637e0-1a4c-4c0c-9c2a-4c4f5fa657bb None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:23.313544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43500935-1f8c-4ae3-b507-76dc3e6447b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:23.314137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43500935-1f8c-4ae3-b507-76dc3e6447b7 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:23.314396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43500935-1f8c-4ae3-b507-76dc3e6447b7 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:23.314677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43500935-1f8c-4ae3-b507-76dc3e6447b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:23.323175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43500935-1f8c-4ae3-b507-76dc3e6447b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:23.349271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43500935-1f8c-4ae3-b507-76dc3e6447b7 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:23.358793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 661/1320] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:33.824621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af324ea1-9afa-47f8-b083-9c2ad25599c3 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:33.825168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af324ea1-9afa-47f8-b083-9c2ad25599c3 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:33.825168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af324ea1-9afa-47f8-b083-9c2ad25599c3 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:33.826966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 660/1321] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:33.832376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9a321-a2f1-4b7d-8f9e-6bfdfd794347 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:33.832845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9a321-a2f1-4b7d-8f9e-6bfdfd794347 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:33.833047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9a321-a2f1-4b7d-8f9e-6bfdfd794347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:33.856514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e1f9a321-a2f1-4b7d-8f9e-6bfdfd794347 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:33.857679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e1f9a321-a2f1-4b7d-8f9e-6bfdfd794347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:33.864893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 662/1322] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:33.927932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3d43-9232-41b1-96bf-830dce63fe65 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:33.928221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3d43-9232-41b1-96bf-830dce63fe65 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:33.928509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3d43-9232-41b1-96bf-830dce63fe65 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:33.931328 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 661/1323] 10.222.0.87 () {54 vars in 962 bytes} [Tue Jan 18 13:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:33.936248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82f6ec-23f5-47de-971d-905dc00fb716 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:33.936546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82f6ec-23f5-47de-971d-905dc00fb716 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:33.936833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82f6ec-23f5-47de-971d-905dc00fb716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:34.006533 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-ba82f6ec-23f5-47de-971d-905dc00fb716 None None] MFA Rules not processed for user `f6fb4643e93c455c9eb828c52b68bbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:34.007784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ba82f6ec-23f5-47de-971d-905dc00fb716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:34.075782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 663/1324] 10.222.0.87 () {58 vars in 1059 bytes} [Tue Jan 18 13:02:33 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:34.082931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3d43-9232-41b1-96bf-830dce63fe65 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:34.094276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3d43-9232-41b1-96bf-830dce63fe65 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:34.097730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f5354-37eb-47f3-bcfb-ab3dd731c918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:34.098508 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f5354-37eb-47f3-bcfb-ab3dd731c918 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:34.098797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f5354-37eb-47f3-bcfb-ab3dd731c918 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:34.099076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f5354-37eb-47f3-bcfb-ab3dd731c918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:34.109240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f5354-37eb-47f3-bcfb-ab3dd731c918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:34.135494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f5354-37eb-47f3-bcfb-ab3dd731c918 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:34.145598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 662/1325] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:47.947696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5344c-32a9-4361-86e0-6cabb664f1a2 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:47.948294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5344c-32a9-4361-86e0-6cabb664f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:47.948294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5344c-32a9-4361-86e0-6cabb664f1a2 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:47.949963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 664/1326] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:47.955107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dccaa-d94a-418e-99b6-8af03c5252b5 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:47.955602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dccaa-d94a-418e-99b6-8af03c5252b5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:47.955708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dccaa-d94a-418e-99b6-8af03c5252b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:47.979526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-2a8dccaa-d94a-418e-99b6-8af03c5252b5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:47.980683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-2a8dccaa-d94a-418e-99b6-8af03c5252b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:47.987856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 663/1327] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:02:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:02:48.061646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2a450-3adf-44c0-99c1-0e14c13900bf None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:48.061940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2a450-3adf-44c0-99c1-0e14c13900bf None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:48.062226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2a450-3adf-44c0-99c1-0e14c13900bf None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:48.063932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 665/1328] 10.222.0.87 () {54 vars in 956 bytes} [Tue Jan 18 13:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:48.070921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f24c55-a7b5-4e6b-b2e6-edb2f32eb092 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:48.071187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f24c55-a7b5-4e6b-b2e6-edb2f32eb092 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:48.071446 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f24c55-a7b5-4e6b-b2e6-edb2f32eb092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:48.141370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-75f24c55-a7b5-4e6b-b2e6-edb2f32eb092 None None] MFA Rules not processed for user `1aecbdda2f524fbca580d99b3001bed4`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:48.142546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-75f24c55-a7b5-4e6b-b2e6-edb2f32eb092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:48.215600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 664/1329] 10.222.0.87 () {58 vars in 1053 bytes} [Tue Jan 18 13:02:48 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:48.224651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2a450-3adf-44c0-99c1-0e14c13900bf None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:48.235174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2a450-3adf-44c0-99c1-0e14c13900bf None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:48.238409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953bccb-20d9-4153-b4c5-465e41d2f184 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aecbdda2f524fbca580d99b3001bed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:48.238977 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953bccb-20d9-4153-b4c5-465e41d2f184 service glance] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:48.239265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953bccb-20d9-4153-b4c5-465e41d2f184 service glance] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:48.239577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953bccb-20d9-4153-b4c5-465e41d2f184 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:48.248307 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953bccb-20d9-4153-b4c5-465e41d2f184 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:48.274453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953bccb-20d9-4153-b4c5-465e41d2f184 service glance] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:48.283769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 666/1330] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:02:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:02:48.851498 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947505a4-2651-40cf-91ed-187b0c215d73 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:48.851795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947505a4-2651-40cf-91ed-187b0c215d73 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:48.852079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947505a4-2651-40cf-91ed-187b0c215d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:48.920647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-947505a4-2651-40cf-91ed-187b0c215d73 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:48.921793 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-947505a4-2651-40cf-91ed-187b0c215d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:48.996745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 665/1331] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:02:48 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:49.041401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0409bd-686b-49eb-bc70-14952b36239c None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:49.041921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0409bd-686b-49eb-bc70-14952b36239c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:49.042045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0409bd-686b-49eb-bc70-14952b36239c None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:49.043744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 667/1332] 10.222.0.87 () {54 vars in 942 bytes} [Tue Jan 18 13:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:02:49.050284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b67fdc-2574-42e8-a313-019897bf517a None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:49.050684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b67fdc-2574-42e8-a313-019897bf517a None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:49.050971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b67fdc-2574-42e8-a313-019897bf517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:49.121654 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-67b67fdc-2574-42e8-a313-019897bf517a None None] MFA Rules not processed for user `e99d0fbbc86b4a629b9fffb4d9565216`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:02:49.125705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-67b67fdc-2574-42e8-a313-019897bf517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:02:49.213885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 666/1333] 10.222.0.87 () {58 vars in 1039 bytes} [Tue Jan 18 13:02:49 2022] POST /identity/v3/auth/tokens => generated 3734 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:02:49.222853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0409bd-686b-49eb-bc70-14952b36239c None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:02:49.235828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0409bd-686b-49eb-bc70-14952b36239c None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:02:49.240306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1271e25-b3df-43fd-9ce8-8e1e3516cee4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:02:49.240868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1271e25-b3df-43fd-9ce8-8e1e3516cee4 service swift] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:02:49.241157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1271e25-b3df-43fd-9ce8-8e1e3516cee4 service swift] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:02:49.241435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1271e25-b3df-43fd-9ce8-8e1e3516cee4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:02:49.250296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1271e25-b3df-43fd-9ce8-8e1e3516cee4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:02:49.275718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1271e25-b3df-43fd-9ce8-8e1e3516cee4 service swift] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:02:49.284184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 668/1334] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:02:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:03:09.666436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaae5db-6c6a-4064-8274-7c308d39dd2f None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:09.667052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaae5db-6c6a-4064-8274-7c308d39dd2f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:09.667052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaae5db-6c6a-4064-8274-7c308d39dd2f None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:09.668749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 667/1335] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:03:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:09.673836 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa646e2-98cd-4306-8ca7-d99afc186b2d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:09.674244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa646e2-98cd-4306-8ca7-d99afc186b2d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:09.674397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa646e2-98cd-4306-8ca7-d99afc186b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:09.697270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-eaa646e2-98cd-4306-8ca7-d99afc186b2d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:09.698391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-eaa646e2-98cd-4306-8ca7-d99afc186b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:09.705269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 669/1336] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:03:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:09.728630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaae5db-6c6a-4064-8274-7c308d39dd2f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:09.740435 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaae5db-6c6a-4064-8274-7c308d39dd2f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:09.744689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b722bc-10b9-4570-93a5-3051fc3a0835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:09.745272 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b722bc-10b9-4570-93a5-3051fc3a0835 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:09.745558 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b722bc-10b9-4570-93a5-3051fc3a0835 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:09.745838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b722bc-10b9-4570-93a5-3051fc3a0835 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:09.746541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b722bc-10b9-4570-93a5-3051fc3a0835 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:09.771968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b722bc-10b9-4570-93a5-3051fc3a0835 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:09.788055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 668/1337] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 13:03:09 2022] GET /identity/v3/projects => generated 2553 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:03:11.773357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d843aa-7fb9-4555-8ff6-88dc54616cdd None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:11.774579 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d843aa-7fb9-4555-8ff6-88dc54616cdd None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:11.776334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d843aa-7fb9-4555-8ff6-88dc54616cdd None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:11.777129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 670/1338] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:03:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:11.782889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d12a0-1d95-4ddd-90cc-ac1fde69a618 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:11.783425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d12a0-1d95-4ddd-90cc-ac1fde69a618 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:11.783522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d12a0-1d95-4ddd-90cc-ac1fde69a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:11.812714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-0a5d12a0-1d95-4ddd-90cc-ac1fde69a618 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:11.813862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0a5d12a0-1d95-4ddd-90cc-ac1fde69a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:11.821627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 669/1339] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:03:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:03:11.844262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d843aa-7fb9-4555-8ff6-88dc54616cdd None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:11.856548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d843aa-7fb9-4555-8ff6-88dc54616cdd None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:11.860583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abdc9-a860-4fdd-bc3a-fbb367e924e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:11.861343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abdc9-a860-4fdd-bc3a-fbb367e924e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:11.861631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abdc9-a860-4fdd-bc3a-fbb367e924e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:11.861923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746abdc9-a860-4fdd-bc3a-fbb367e924e8 admin admin] PATH_INFO: `/v3/projects/1117f315d9504eb48d577b68fe353f07` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:11.876827 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746abdc9-a860-4fdd-bc3a-fbb367e924e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=1117f315d9504eb48d577b68fe353f07)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:11.905506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746abdc9-a860-4fdd-bc3a-fbb367e924e8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:11.907177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 671/1340] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:03:11 2022] GET /identity/v3/projects/1117f315d9504eb48d577b68fe353f07 => generated 361 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:11.913734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d12a0-1d95-4ddd-90cc-ac1fde69a618 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:11.922629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d12a0-1d95-4ddd-90cc-ac1fde69a618 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:11.926873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89de0d-08c6-40a8-a839-32b33c44416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:11.927473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89de0d-08c6-40a8-a839-32b33c44416f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:11.927756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89de0d-08c6-40a8-a839-32b33c44416f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:11.928029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89de0d-08c6-40a8-a839-32b33c44416f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:11.928831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89de0d-08c6-40a8-a839-32b33c44416f admin admin] RBAC: Adding query filter params (scope.project.id=1117f315d9504eb48d577b68fe353f07) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:03:11.929127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89de0d-08c6-40a8-a839-32b33c44416f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:11.955856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89de0d-08c6-40a8-a839-32b33c44416f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:11.962166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 670/1341] 10.222.0.87 () {56 vars in 1231 bytes} [Tue Jan 18 13:03:11 2022] GET /identity/v3/role_assignments?scope.project.id=1117f315d9504eb48d577b68fe353f07 => generated 526 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:11.968092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abdc9-a860-4fdd-bc3a-fbb367e924e8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:11.977475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746abdc9-a860-4fdd-bc3a-fbb367e924e8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:11.981611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef676c5-e1c6-4fd9-86f9-5f15307d5e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:11.982388 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef676c5-e1c6-4fd9-86f9-5f15307d5e61 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:11.982670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef676c5-e1c6-4fd9-86f9-5f15307d5e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:11.982945 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef676c5-e1c6-4fd9-86f9-5f15307d5e61 admin admin] PATH_INFO: `/v3/users/cb278dbf152943d4be16bca5f9564726` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:12.002057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef676c5-e1c6-4fd9-86f9-5f15307d5e61 admin admin] RBAC: Authorizing `identity:get_user(user_id=cb278dbf152943d4be16bca5f9564726)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:12.028749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef676c5-e1c6-4fd9-86f9-5f15307d5e61 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:12.030256 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 672/1342] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:11 2022] GET /identity/v3/users/cb278dbf152943d4be16bca5f9564726 => generated 311 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:14.100872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b998f-828f-458f-aa9c-5aca88c8166f None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:14.101404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b998f-828f-458f-aa9c-5aca88c8166f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:14.101404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b998f-828f-458f-aa9c-5aca88c8166f None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:14.103741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 671/1343] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:14.109638 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b15765-9da5-4196-81ac-3fc5557b98c0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:14.110154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b15765-9da5-4196-81ac-3fc5557b98c0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:14.110257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b15765-9da5-4196-81ac-3fc5557b98c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:14.133971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-28b15765-9da5-4196-81ac-3fc5557b98c0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:14.135156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-28b15765-9da5-4196-81ac-3fc5557b98c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:14.142277 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 673/1344] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:14.170477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b998f-828f-458f-aa9c-5aca88c8166f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:14.184284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b998f-828f-458f-aa9c-5aca88c8166f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:14.188425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe3855-8b0f-4518-adeb-b78ec7f5a9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:14.189209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe3855-8b0f-4518-adeb-b78ec7f5a9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:14.189500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe3855-8b0f-4518-adeb-b78ec7f5a9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:14.189785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe3855-8b0f-4518-adeb-b78ec7f5a9e6 admin admin] PATH_INFO: `/v3/projects/15f72aeccb644494a5efc48bc0da913d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:14.203101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe3855-8b0f-4518-adeb-b78ec7f5a9e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=15f72aeccb644494a5efc48bc0da913d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:14.231723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe3855-8b0f-4518-adeb-b78ec7f5a9e6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:14.233428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 672/1345] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:03:14 2022] GET /identity/v3/projects/15f72aeccb644494a5efc48bc0da913d => generated 311 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:14.239543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b15765-9da5-4196-81ac-3fc5557b98c0 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:14.248594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b15765-9da5-4196-81ac-3fc5557b98c0 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:14.252793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcea5c-fcb5-45af-b1f2-244084c8f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:14.253374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcea5c-fcb5-45af-b1f2-244084c8f85f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:14.253656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcea5c-fcb5-45af-b1f2-244084c8f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:14.253933 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadcea5c-fcb5-45af-b1f2-244084c8f85f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:14.254649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcea5c-fcb5-45af-b1f2-244084c8f85f admin admin] RBAC: Adding query filter params (scope.project.id=15f72aeccb644494a5efc48bc0da913d) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:03:14.254946 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcea5c-fcb5-45af-b1f2-244084c8f85f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:14.281338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadcea5c-fcb5-45af-b1f2-244084c8f85f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:14.288126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 674/1346] 10.222.0.87 () {56 vars in 1231 bytes} [Tue Jan 18 13:03:14 2022] GET /identity/v3/role_assignments?scope.project.id=15f72aeccb644494a5efc48bc0da913d => generated 877 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:14.295210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe3855-8b0f-4518-adeb-b78ec7f5a9e6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:14.304962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe3855-8b0f-4518-adeb-b78ec7f5a9e6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:14.309435 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eda8da-e958-40cf-9107-4dee30107943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:14.310227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda8da-e958-40cf-9107-4dee30107943 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:14.310520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda8da-e958-40cf-9107-4dee30107943 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:14.310809 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eda8da-e958-40cf-9107-4dee30107943 admin admin] PATH_INFO: `/v3/users/d8757db797bc42fdb47482ccc81f7f7a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:14.329972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eda8da-e958-40cf-9107-4dee30107943 admin admin] RBAC: Authorizing `identity:get_user(user_id=d8757db797bc42fdb47482ccc81f7f7a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:14.357223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eda8da-e958-40cf-9107-4dee30107943 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:14.358796 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 673/1347] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:14 2022] GET /identity/v3/users/d8757db797bc42fdb47482ccc81f7f7a => generated 285 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:14.364736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcea5c-fcb5-45af-b1f2-244084c8f85f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:14.374937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadcea5c-fcb5-45af-b1f2-244084c8f85f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:14.379414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a91e92-e438-4e10-9e91-826bc6582db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:14.380206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a91e92-e438-4e10-9e91-826bc6582db8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:14.380498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a91e92-e438-4e10-9e91-826bc6582db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:14.380778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a91e92-e438-4e10-9e91-826bc6582db8 admin admin] PATH_INFO: `/v3/users/d363a5ec9e1246499cccc589b5e8a6bd` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:14.400955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a91e92-e438-4e10-9e91-826bc6582db8 admin admin] RBAC: Authorizing `identity:get_user(user_id=d363a5ec9e1246499cccc589b5e8a6bd)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:14.427705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a91e92-e438-4e10-9e91-826bc6582db8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:14.429334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 675/1348] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:14 2022] GET /identity/v3/users/d363a5ec9e1246499cccc589b5e8a6bd => generated 286 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:16.591441 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82227bcc-34f8-4a3a-9c66-5b3f59788d07 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:16.592041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82227bcc-34f8-4a3a-9c66-5b3f59788d07 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:16.592041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82227bcc-34f8-4a3a-9c66-5b3f59788d07 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:16.593682 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 674/1349] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:16.599120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3639e-17f2-4b17-9348-002a04d7bb31 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:16.599636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3639e-17f2-4b17-9348-002a04d7bb31 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:16.599746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3639e-17f2-4b17-9348-002a04d7bb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:16.623658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-31c3639e-17f2-4b17-9348-002a04d7bb31 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:16.624800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-31c3639e-17f2-4b17-9348-002a04d7bb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:16.631761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 676/1350] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:03:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:16.655037 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82227bcc-34f8-4a3a-9c66-5b3f59788d07 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:16.667778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82227bcc-34f8-4a3a-9c66-5b3f59788d07 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:16.672100 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3844-ad09-4b43-b4be-b243561cb844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:16.672888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3844-ad09-4b43-b4be-b243561cb844 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:16.673175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3844-ad09-4b43-b4be-b243561cb844 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:16.673531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a3844-ad09-4b43-b4be-b243561cb844 admin admin] PATH_INFO: `/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:16.687250 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a3844-ad09-4b43-b4be-b243561cb844 admin admin] RBAC: Authorizing `identity:get_project(project_id=3f9bc9181cf94d6cae3e9ca6fa48c81d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:16.713669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a3844-ad09-4b43-b4be-b243561cb844 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:16.715373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 675/1351] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:03:16 2022] GET /identity/v3/projects/3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 302 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:16.721372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3639e-17f2-4b17-9348-002a04d7bb31 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:16.730679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3639e-17f2-4b17-9348-002a04d7bb31 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:16.734871 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f875b-ab60-47d9-a52e-4edbaa2c1cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:16.735477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f875b-ab60-47d9-a52e-4edbaa2c1cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:16.735769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f875b-ab60-47d9-a52e-4edbaa2c1cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:16.736052 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f875b-ab60-47d9-a52e-4edbaa2c1cf8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:16.736769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f875b-ab60-47d9-a52e-4edbaa2c1cf8 admin admin] RBAC: Adding query filter params (scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:03:16.737072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f875b-ab60-47d9-a52e-4edbaa2c1cf8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:16.764736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f875b-ab60-47d9-a52e-4edbaa2c1cf8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:16.772044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 677/1352] 10.222.0.87 () {56 vars in 1231 bytes} [Tue Jan 18 13:03:16 2022] GET /identity/v3/role_assignments?scope.project.id=3f9bc9181cf94d6cae3e9ca6fa48c81d => generated 1934 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:03:16.780084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3844-ad09-4b43-b4be-b243561cb844 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:16.790046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a3844-ad09-4b43-b4be-b243561cb844 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:16.794244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb774b5-12dd-402b-b679-ab65a7f6043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:16.795045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb774b5-12dd-402b-b679-ab65a7f6043f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:16.795354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb774b5-12dd-402b-b679-ab65a7f6043f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:16.795640 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb774b5-12dd-402b-b679-ab65a7f6043f admin admin] PATH_INFO: `/v3/users/80d94a60f9304f468fc1b26f4c68b6be` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:16.815080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb774b5-12dd-402b-b679-ab65a7f6043f admin admin] RBAC: Authorizing `identity:get_user(user_id=80d94a60f9304f468fc1b26f4c68b6be)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:16.841673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb774b5-12dd-402b-b679-ab65a7f6043f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:16.843160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 676/1353] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:16 2022] GET /identity/v3/users/80d94a60f9304f468fc1b26f4c68b6be => generated 283 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:16.849245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f875b-ab60-47d9-a52e-4edbaa2c1cf8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:16.859354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f875b-ab60-47d9-a52e-4edbaa2c1cf8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:16.864099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0f4125-917e-408e-bc56-cf32d4cbba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:16.864923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4125-917e-408e-bc56-cf32d4cbba89 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:16.865216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4125-917e-408e-bc56-cf32d4cbba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:16.865497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0f4125-917e-408e-bc56-cf32d4cbba89 admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:16.866580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f4125-917e-408e-bc56-cf32d4cbba89 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:16.892871 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0f4125-917e-408e-bc56-cf32d4cbba89 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:16.894347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 678/1354] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:16 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:19.036340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b7b1-ae67-40d6-8a44-beb794083bfd None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:19.037193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b7b1-ae67-40d6-8a44-beb794083bfd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:19.037193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39b7b1-ae67-40d6-8a44-beb794083bfd None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:19.038881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 677/1355] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:19.045780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f97488-186e-44fc-9d49-1ca187cd03db None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:19.046324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f97488-186e-44fc-9d49-1ca187cd03db None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:19.046845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f97488-186e-44fc-9d49-1ca187cd03db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:19.077491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-61f97488-186e-44fc-9d49-1ca187cd03db None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:19.078648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-61f97488-186e-44fc-9d49-1ca187cd03db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:19.087294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 679/1356] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:03:19 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:19.110626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39b7b1-ae67-40d6-8a44-beb794083bfd None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:19.122994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39b7b1-ae67-40d6-8a44-beb794083bfd None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:19.127409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb683-c41b-4134-a96a-fb271f0e2d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:19.128198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb683-c41b-4134-a96a-fb271f0e2d36 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:19.128486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb683-c41b-4134-a96a-fb271f0e2d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:19.128773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb683-c41b-4134-a96a-fb271f0e2d36 admin admin] PATH_INFO: `/v3/projects/6989cbd135d744de861fa22cace1177a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:19.142937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eeb683-c41b-4134-a96a-fb271f0e2d36 admin admin] RBAC: Authorizing `identity:get_project(project_id=6989cbd135d744de861fa22cace1177a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:19.170433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eeb683-c41b-4134-a96a-fb271f0e2d36 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:19.172227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 678/1357] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:03:19 2022] GET /identity/v3/projects/6989cbd135d744de861fa22cace1177a => generated 298 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:19.178516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f97488-186e-44fc-9d49-1ca187cd03db None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:19.188290 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f97488-186e-44fc-9d49-1ca187cd03db None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:19.193188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922151-fd6b-49f8-8ddd-b54783ca5967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:19.193779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922151-fd6b-49f8-8ddd-b54783ca5967 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:19.194073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922151-fd6b-49f8-8ddd-b54783ca5967 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:19.194358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b922151-fd6b-49f8-8ddd-b54783ca5967 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:19.195085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b922151-fd6b-49f8-8ddd-b54783ca5967 admin admin] RBAC: Adding query filter params (scope.project.id=6989cbd135d744de861fa22cace1177a) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:03:19.196188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b922151-fd6b-49f8-8ddd-b54783ca5967 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:19.224929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b922151-fd6b-49f8-8ddd-b54783ca5967 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:19.233375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 680/1358] 10.222.0.87 () {56 vars in 1231 bytes} [Tue Jan 18 13:03:19 2022] GET /identity/v3/role_assignments?scope.project.id=6989cbd135d744de861fa22cace1177a => generated 1934 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:03:19.239529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb683-c41b-4134-a96a-fb271f0e2d36 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:19.250895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb683-c41b-4134-a96a-fb271f0e2d36 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:19.255598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abad2e-eeb7-4c6c-a598-4c6e576c7c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:19.256488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abad2e-eeb7-4c6c-a598-4c6e576c7c9e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:19.256938 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abad2e-eeb7-4c6c-a598-4c6e576c7c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:19.257322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abad2e-eeb7-4c6c-a598-4c6e576c7c9e admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:19.278282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abad2e-eeb7-4c6c-a598-4c6e576c7c9e admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:19.305985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abad2e-eeb7-4c6c-a598-4c6e576c7c9e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:19.307713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 679/1359] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:19 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:19.313831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922151-fd6b-49f8-8ddd-b54783ca5967 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:19.323694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b922151-fd6b-49f8-8ddd-b54783ca5967 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:19.328568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f00748-f1ac-48ba-a1e1-a72c9ca1067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:19.329449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00748-f1ac-48ba-a1e1-a72c9ca1067d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:19.329742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00748-f1ac-48ba-a1e1-a72c9ca1067d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:19.330031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f00748-f1ac-48ba-a1e1-a72c9ca1067d admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:19.331132 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f00748-f1ac-48ba-a1e1-a72c9ca1067d admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:19.365643 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f00748-f1ac-48ba-a1e1-a72c9ca1067d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:19.368011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 681/1360] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:19 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:21.497175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbeb2b3-12c3-43e7-9364-ac4d21bd36d6 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:21.497749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbeb2b3-12c3-43e7-9364-ac4d21bd36d6 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:21.497852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbeb2b3-12c3-43e7-9364-ac4d21bd36d6 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:21.499899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 680/1361] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:03:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:21.506525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af940e5e-70e8-4730-bf67-c74444155165 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:21.507383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af940e5e-70e8-4730-bf67-c74444155165 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:21.507383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af940e5e-70e8-4730-bf67-c74444155165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:21.552915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-af940e5e-70e8-4730-bf67-c74444155165 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:21.556603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-af940e5e-70e8-4730-bf67-c74444155165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:21.562110 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 682/1362] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:03:21.586108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbeb2b3-12c3-43e7-9364-ac4d21bd36d6 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:21.605327 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbeb2b3-12c3-43e7-9364-ac4d21bd36d6 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:21.610839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efabb00-c9fd-4f11-b36d-ad94a313ec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:21.611695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efabb00-c9fd-4f11-b36d-ad94a313ec9e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:21.612007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efabb00-c9fd-4f11-b36d-ad94a313ec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:21.612258 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efabb00-c9fd-4f11-b36d-ad94a313ec9e admin admin] PATH_INFO: `/v3/projects/988f3d8cde054c43b19e2f861211cb0a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:21.627506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efabb00-c9fd-4f11-b36d-ad94a313ec9e admin admin] RBAC: Authorizing `identity:get_project(project_id=988f3d8cde054c43b19e2f861211cb0a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:21.654952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efabb00-c9fd-4f11-b36d-ad94a313ec9e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:21.656693 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 681/1363] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:03:21 2022] GET /identity/v3/projects/988f3d8cde054c43b19e2f861211cb0a => generated 311 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:03:21.663866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af940e5e-70e8-4730-bf67-c74444155165 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:21.673704 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af940e5e-70e8-4730-bf67-c74444155165 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:21.678254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a874f23-e278-4dda-a3a5-de141df390ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:21.678891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874f23-e278-4dda-a3a5-de141df390ba admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:21.679617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874f23-e278-4dda-a3a5-de141df390ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:21.679617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a874f23-e278-4dda-a3a5-de141df390ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:21.682898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a874f23-e278-4dda-a3a5-de141df390ba admin admin] RBAC: Adding query filter params (scope.project.id=988f3d8cde054c43b19e2f861211cb0a) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:03:21.682898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a874f23-e278-4dda-a3a5-de141df390ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:21.708776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a874f23-e278-4dda-a3a5-de141df390ba admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:21.715966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 683/1364] 10.222.0.87 () {56 vars in 1231 bytes} [Tue Jan 18 13:03:21 2022] GET /identity/v3/role_assignments?scope.project.id=988f3d8cde054c43b19e2f861211cb0a => generated 526 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:03:21.725523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efabb00-c9fd-4f11-b36d-ad94a313ec9e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:21.735994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efabb00-c9fd-4f11-b36d-ad94a313ec9e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:21.740494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94022cf2-9ed6-4aef-a182-51b7f63eb8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:21.741316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94022cf2-9ed6-4aef-a182-51b7f63eb8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:21.741600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94022cf2-9ed6-4aef-a182-51b7f63eb8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:21.741877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94022cf2-9ed6-4aef-a182-51b7f63eb8b6 admin admin] PATH_INFO: `/v3/users/07781d6c9a9b4f708ff604ff9974d9ca` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:21.763563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94022cf2-9ed6-4aef-a182-51b7f63eb8b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=07781d6c9a9b4f708ff604ff9974d9ca)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:21.789954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94022cf2-9ed6-4aef-a182-51b7f63eb8b6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:21.791683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 682/1365] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:21 2022] GET /identity/v3/users/07781d6c9a9b4f708ff604ff9974d9ca => generated 286 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:24.003540 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49df2-edff-4054-bf99-c86e0a4b5551 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:24.004576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49df2-edff-4054-bf99-c86e0a4b5551 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:24.005080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49df2-edff-4054-bf99-c86e0a4b5551 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:24.006998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 684/1366] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:03:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:24.014668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4e8c-7211-44d5-9db0-55facb11cbd3 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:24.019127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4e8c-7211-44d5-9db0-55facb11cbd3 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:24.019127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a4e8c-7211-44d5-9db0-55facb11cbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:24.038700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-be9a4e8c-7211-44d5-9db0-55facb11cbd3 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:24.040106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-be9a4e8c-7211-44d5-9db0-55facb11cbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:24.047648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 683/1367] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:03:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:24.070294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c49df2-edff-4054-bf99-c86e0a4b5551 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:24.083981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c49df2-edff-4054-bf99-c86e0a4b5551 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:24.089880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d2b7-c0dd-4aaa-9354-c4b5901f5901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:24.090678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d2b7-c0dd-4aaa-9354-c4b5901f5901 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:24.090962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d2b7-c0dd-4aaa-9354-c4b5901f5901 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:24.091235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5d2b7-c0dd-4aaa-9354-c4b5901f5901 admin admin] PATH_INFO: `/v3/projects/e94347012917407aa446d366e5635e39` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:24.105886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d2b7-c0dd-4aaa-9354-c4b5901f5901 admin admin] RBAC: Authorizing `identity:get_project(project_id=e94347012917407aa446d366e5635e39)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:24.133818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5d2b7-c0dd-4aaa-9354-c4b5901f5901 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:24.135630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 685/1368] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:03:24 2022] GET /identity/v3/projects/e94347012917407aa446d366e5635e39 => generated 312 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:24.141818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a4e8c-7211-44d5-9db0-55facb11cbd3 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:24.150685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a4e8c-7211-44d5-9db0-55facb11cbd3 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:24.154846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26116c29-c0c5-4ff8-bd41-a5b7ce3dc3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:24.155475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116c29-c0c5-4ff8-bd41-a5b7ce3dc3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:24.155757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116c29-c0c5-4ff8-bd41-a5b7ce3dc3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:24.156038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26116c29-c0c5-4ff8-bd41-a5b7ce3dc3e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:24.156765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116c29-c0c5-4ff8-bd41-a5b7ce3dc3e2 admin admin] RBAC: Adding query filter params (scope.project.id=e94347012917407aa446d366e5635e39) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:03:24.157049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116c29-c0c5-4ff8-bd41-a5b7ce3dc3e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:24.183827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26116c29-c0c5-4ff8-bd41-a5b7ce3dc3e2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:24.189887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 684/1369] 10.222.0.87 () {56 vars in 1231 bytes} [Tue Jan 18 13:03:24 2022] GET /identity/v3/role_assignments?scope.project.id=e94347012917407aa446d366e5635e39 => generated 526 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:24.196591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d2b7-c0dd-4aaa-9354-c4b5901f5901 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:24.206406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5d2b7-c0dd-4aaa-9354-c4b5901f5901 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:24.210594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a04ff3-9d48-45a2-b9bf-e6dd9e3c5172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:24.211428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a04ff3-9d48-45a2-b9bf-e6dd9e3c5172 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:24.211803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a04ff3-9d48-45a2-b9bf-e6dd9e3c5172 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:24.212094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a04ff3-9d48-45a2-b9bf-e6dd9e3c5172 admin admin] PATH_INFO: `/v3/users/c143e78768494434979863997771120b` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:24.213184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a04ff3-9d48-45a2-b9bf-e6dd9e3c5172 admin admin] RBAC: Authorizing `identity:get_user(user_id=c143e78768494434979863997771120b)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:24.239322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a04ff3-9d48-45a2-b9bf-e6dd9e3c5172 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:24.240952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 686/1370] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:24 2022] GET /identity/v3/users/c143e78768494434979863997771120b => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:26.315390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1b923-80cd-4d1f-855b-583384272d2f None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:26.315996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1b923-80cd-4d1f-855b-583384272d2f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:26.315996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1b923-80cd-4d1f-855b-583384272d2f None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:26.317734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 685/1371] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:26.324690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2383f4-bebf-4bb4-a5ed-0809186d7b84 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:26.325276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2383f4-bebf-4bb4-a5ed-0809186d7b84 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:26.325276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2383f4-bebf-4bb4-a5ed-0809186d7b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:26.354167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-8a2383f4-bebf-4bb4-a5ed-0809186d7b84 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:26.355352 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-8a2383f4-bebf-4bb4-a5ed-0809186d7b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:26.362572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 687/1372] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:03:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:26.385964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1b923-80cd-4d1f-855b-583384272d2f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:26.404543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1b923-80cd-4d1f-855b-583384272d2f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:26.410439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d727d7-ddd1-4184-a051-58da1bf8385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:26.412395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d727d7-ddd1-4184-a051-58da1bf8385c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:26.412696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d727d7-ddd1-4184-a051-58da1bf8385c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:26.413191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d727d7-ddd1-4184-a051-58da1bf8385c admin admin] PATH_INFO: `/v3/projects/efd990fcb71545ffb5735fe49db625b4` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:26.415743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d727d7-ddd1-4184-a051-58da1bf8385c admin admin] RBAC: Authorizing `identity:get_project(project_id=efd990fcb71545ffb5735fe49db625b4)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:26.472033 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d727d7-ddd1-4184-a051-58da1bf8385c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:26.475189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 686/1373] 10.222.0.87 () {56 vars in 1207 bytes} [Tue Jan 18 13:03:26 2022] GET /identity/v3/projects/efd990fcb71545ffb5735fe49db625b4 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:26.482791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2383f4-bebf-4bb4-a5ed-0809186d7b84 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:26.494765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2383f4-bebf-4bb4-a5ed-0809186d7b84 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:26.505770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5907c16-96bf-4b69-8c67-7f8ec85121e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:26.506377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5907c16-96bf-4b69-8c67-7f8ec85121e3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:26.506696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5907c16-96bf-4b69-8c67-7f8ec85121e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:26.506984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5907c16-96bf-4b69-8c67-7f8ec85121e3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:26.509387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5907c16-96bf-4b69-8c67-7f8ec85121e3 admin admin] RBAC: Adding query filter params (scope.project.id=efd990fcb71545ffb5735fe49db625b4) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:03:26.509387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5907c16-96bf-4b69-8c67-7f8ec85121e3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:26.538230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5907c16-96bf-4b69-8c67-7f8ec85121e3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:26.546013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 688/1374] 10.222.0.87 () {56 vars in 1231 bytes} [Tue Jan 18 13:03:26 2022] GET /identity/v3/role_assignments?scope.project.id=efd990fcb71545ffb5735fe49db625b4 => generated 879 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:03:26.552652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d727d7-ddd1-4184-a051-58da1bf8385c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:26.562680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d727d7-ddd1-4184-a051-58da1bf8385c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:26.566984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39effa92-6be0-4085-9f74-33a9b168c66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:26.567815 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39effa92-6be0-4085-9f74-33a9b168c66d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:26.568096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39effa92-6be0-4085-9f74-33a9b168c66d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:26.568372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39effa92-6be0-4085-9f74-33a9b168c66d admin admin] PATH_INFO: `/v3/users/4b6ba909638e4d95a0827152d2079014` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:26.569466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39effa92-6be0-4085-9f74-33a9b168c66d admin admin] RBAC: Authorizing `identity:get_user(user_id=4b6ba909638e4d95a0827152d2079014)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:26.596258 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39effa92-6be0-4085-9f74-33a9b168c66d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:26.597896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 687/1375] 10.222.0.87 () {56 vars in 1198 bytes} [Tue Jan 18 13:03:26 2022] GET /identity/v3/users/4b6ba909638e4d95a0827152d2079014 => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:03:31.746286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7f99-2255-4082-b79c-5e2c9b4a70bc None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:31.746890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7f99-2255-4082-b79c-5e2c9b4a70bc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:31.746890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd7f99-2255-4082-b79c-5e2c9b4a70bc None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:31.748585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 689/1376] 10.222.0.87 () {54 vars in 918 bytes} [Tue Jan 18 13:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:31.754135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29146-3628-4974-9a83-5f8297a0fa23 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:31.754645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29146-3628-4974-9a83-5f8297a0fa23 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:31.754775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b29146-3628-4974-9a83-5f8297a0fa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:31.782929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-56b29146-3628-4974-9a83-5f8297a0fa23 None None] MFA Rules not processed for user `0a678f789e3549a3b634acc510c5d0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:31.784243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-56b29146-3628-4974-9a83-5f8297a0fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:31.793297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 688/1377] 10.222.0.87 () {58 vars in 1015 bytes} [Tue Jan 18 13:03:31 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:31.858281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6421b6-b828-4a9c-8018-93b358d7ef7f None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:31.858568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6421b6-b828-4a9c-8018-93b358d7ef7f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:31.858857 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6421b6-b828-4a9c-8018-93b358d7ef7f None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:31.860599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 690/1378] 10.222.0.87 () {54 vars in 918 bytes} [Tue Jan 18 13:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:31.866085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9b1c3-b979-4f60-b367-ddc119191d24 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:31.866373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9b1c3-b979-4f60-b367-ddc119191d24 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:31.866655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9b1c3-b979-4f60-b367-ddc119191d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:31.891876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-7fc9b1c3-b979-4f60-b367-ddc119191d24 None None] MFA Rules not processed for user `394a96c082ed47bbbd645b489a4ed208`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:31.893092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7fc9b1c3-b979-4f60-b367-ddc119191d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:31.902812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 689/1379] 10.222.0.87 () {58 vars in 1015 bytes} [Tue Jan 18 13:03:31 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:34.299178 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f7256-5ab5-4951-b8d8-21d304fa5255 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:34.299888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f7256-5ab5-4951-b8d8-21d304fa5255 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:34.299888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f7256-5ab5-4951-b8d8-21d304fa5255 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:34.301430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 691/1380] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:34.307784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4fc4e-3871-4d87-b340-d14e0a4d51de None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:34.308280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4fc4e-3871-4d87-b340-d14e0a4d51de None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:34.308413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4fc4e-3871-4d87-b340-d14e0a4d51de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:34.330971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-9ea4fc4e-3871-4d87-b340-d14e0a4d51de None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:34.332148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9ea4fc4e-3871-4d87-b340-d14e0a4d51de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:34.339946 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 690/1381] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:03:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:03:34.427867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f7256-5ab5-4951-b8d8-21d304fa5255 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:34.441822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f7256-5ab5-4951-b8d8-21d304fa5255 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:34.446826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1890dae-54ec-4aa6-8d8d-4e7cd2f08760 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:34.447437 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1890dae-54ec-4aa6-8d8d-4e7cd2f08760 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:34.447825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1890dae-54ec-4aa6-8d8d-4e7cd2f08760 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:34.448141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1890dae-54ec-4aa6-8d8d-4e7cd2f08760 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:34.456739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1890dae-54ec-4aa6-8d8d-4e7cd2f08760 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:34.483483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1890dae-54ec-4aa6-8d8d-4e7cd2f08760 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:34.493648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 692/1382] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:35.904631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca52207-0563-4bb4-bcb9-3bd1114322fa None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:35.905241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca52207-0563-4bb4-bcb9-3bd1114322fa None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:35.905241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca52207-0563-4bb4-bcb9-3bd1114322fa None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:35.906850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 691/1383] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:35.912393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0984f09-b604-40b9-a318-a8ea95f724e5 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:35.912867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0984f09-b604-40b9-a318-a8ea95f724e5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:35.912968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0984f09-b604-40b9-a318-a8ea95f724e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:35.937566 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c0984f09-b604-40b9-a318-a8ea95f724e5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:35.938796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c0984f09-b604-40b9-a318-a8ea95f724e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:35.946979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 693/1384] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:03:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:36.105155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca52207-0563-4bb4-bcb9-3bd1114322fa None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:36.121609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca52207-0563-4bb4-bcb9-3bd1114322fa None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:36.126754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1154ce7-4599-4a2b-a39b-ed8bc04a206a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:36.127364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1154ce7-4599-4a2b-a39b-ed8bc04a206a service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:36.127656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1154ce7-4599-4a2b-a39b-ed8bc04a206a service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:36.132415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1154ce7-4599-4a2b-a39b-ed8bc04a206a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:36.137527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1154ce7-4599-4a2b-a39b-ed8bc04a206a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:36.164325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1154ce7-4599-4a2b-a39b-ed8bc04a206a service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:36.175616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 692/1385] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:37.657588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff248-5ccb-48e5-b5ff-4716392b5d15 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:37.658163 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff248-5ccb-48e5-b5ff-4716392b5d15 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:37.658163 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cff248-5ccb-48e5-b5ff-4716392b5d15 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:37.659915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 694/1386] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:37.666141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740babd-acec-4cad-955a-0dc3a70dde5b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:37.666637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740babd-acec-4cad-955a-0dc3a70dde5b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:37.666759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740babd-acec-4cad-955a-0dc3a70dde5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:37.692132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f740babd-acec-4cad-955a-0dc3a70dde5b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:37.697410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f740babd-acec-4cad-955a-0dc3a70dde5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:37.700447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 693/1387] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:03:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:03:37.859186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff248-5ccb-48e5-b5ff-4716392b5d15 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:37.874559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cff248-5ccb-48e5-b5ff-4716392b5d15 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:37.879845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39492b1-4c57-44d6-8c05-047771caf8b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:37.880420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39492b1-4c57-44d6-8c05-047771caf8b9 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:37.880723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39492b1-4c57-44d6-8c05-047771caf8b9 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:37.880970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39492b1-4c57-44d6-8c05-047771caf8b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:37.889718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39492b1-4c57-44d6-8c05-047771caf8b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:37.916705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39492b1-4c57-44d6-8c05-047771caf8b9 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:37.926643 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 695/1388] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:37 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:39.383415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18e7c1-c267-4ef0-a6f4-3ce3780452e3 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:39.383958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18e7c1-c267-4ef0-a6f4-3ce3780452e3 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:39.383958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18e7c1-c267-4ef0-a6f4-3ce3780452e3 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:39.385642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 694/1389] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:39.390514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032355-c1d6-4841-a234-259cdf1a87c4 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:39.390914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032355-c1d6-4841-a234-259cdf1a87c4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:39.391089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c032355-c1d6-4841-a234-259cdf1a87c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:39.414670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-2c032355-c1d6-4841-a234-259cdf1a87c4 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:39.415898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2c032355-c1d6-4841-a234-259cdf1a87c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:39.422767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 696/1390] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:03:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:39.571286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18e7c1-c267-4ef0-a6f4-3ce3780452e3 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:39.584928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18e7c1-c267-4ef0-a6f4-3ce3780452e3 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:39.589876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b1109-c893-4c53-959d-d50292562213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:39.590443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b1109-c893-4c53-959d-d50292562213 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:39.590734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b1109-c893-4c53-959d-d50292562213 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:39.591023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b1109-c893-4c53-959d-d50292562213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:39.599006 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b1109-c893-4c53-959d-d50292562213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:39.624743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b1109-c893-4c53-959d-d50292562213 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:39.634742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 695/1391] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:03:41.105438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6078c-aae3-4f17-8a4f-13af85a91713 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:41.105887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6078c-aae3-4f17-8a4f-13af85a91713 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:41.106014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6078c-aae3-4f17-8a4f-13af85a91713 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:41.107721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 697/1392] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:41.112736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3bdb-99ba-4983-a4fc-0733d1d5a2cc None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:41.113171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3bdb-99ba-4983-a4fc-0733d1d5a2cc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:41.113286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3bdb-99ba-4983-a4fc-0733d1d5a2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:41.136763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c43a3bdb-99ba-4983-a4fc-0733d1d5a2cc None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:41.137944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c43a3bdb-99ba-4983-a4fc-0733d1d5a2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:41.147271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 696/1393] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:03:41.297805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6078c-aae3-4f17-8a4f-13af85a91713 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:41.312718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6078c-aae3-4f17-8a4f-13af85a91713 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:41.317677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180491b-7fe5-4ad4-bc88-4e911ddeaa66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:41.318773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180491b-7fe5-4ad4-bc88-4e911ddeaa66 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:41.319357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180491b-7fe5-4ad4-bc88-4e911ddeaa66 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:41.323732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180491b-7fe5-4ad4-bc88-4e911ddeaa66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:41.329969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180491b-7fe5-4ad4-bc88-4e911ddeaa66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:41.357576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180491b-7fe5-4ad4-bc88-4e911ddeaa66 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:41.368262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 698/1394] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:41 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:42.787031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1674df1-01ff-4ef5-bbe5-f0a2509acc36 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:42.787669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1674df1-01ff-4ef5-bbe5-f0a2509acc36 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:42.787669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1674df1-01ff-4ef5-bbe5-f0a2509acc36 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:42.790026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 697/1395] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 13:03:42.795287 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d3570-8832-4f6b-b06a-76109be82420 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:42.795774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d3570-8832-4f6b-b06a-76109be82420 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:42.795920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d3570-8832-4f6b-b06a-76109be82420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:42.820203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-fc4d3570-8832-4f6b-b06a-76109be82420 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:42.821538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-fc4d3570-8832-4f6b-b06a-76109be82420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:42.828998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 699/1396] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:03:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:42.985651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1674df1-01ff-4ef5-bbe5-f0a2509acc36 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:43.001830 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1674df1-01ff-4ef5-bbe5-f0a2509acc36 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:43.011475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1752c2a-8f23-42d6-989a-a8d6ef980287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:43.012502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752c2a-8f23-42d6-989a-a8d6ef980287 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:43.013024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752c2a-8f23-42d6-989a-a8d6ef980287 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:43.013519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1752c2a-8f23-42d6-989a-a8d6ef980287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:43.028804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1752c2a-8f23-42d6-989a-a8d6ef980287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:43.060689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1752c2a-8f23-42d6-989a-a8d6ef980287 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:43.069941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 698/1397] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:44.511620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b53d67-61c8-4afe-9d29-42f17339a495 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:44.512276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b53d67-61c8-4afe-9d29-42f17339a495 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:44.512276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b53d67-61c8-4afe-9d29-42f17339a495 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:44.513883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 700/1398] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 18 13:03:44.519107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed20f1b-f24b-4706-9abd-b01b0c7c3bae None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:44.519664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed20f1b-f24b-4706-9abd-b01b0c7c3bae None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:44.519784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed20f1b-f24b-4706-9abd-b01b0c7c3bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:44.544268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-6ed20f1b-f24b-4706-9abd-b01b0c7c3bae None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:44.545728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6ed20f1b-f24b-4706-9abd-b01b0c7c3bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:44.554246 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 699/1399] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:44.704293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b53d67-61c8-4afe-9d29-42f17339a495 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:44.718142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b53d67-61c8-4afe-9d29-42f17339a495 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:44.723056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b832c2e-1b0f-41c1-8f68-f24b2c8a109e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:44.723660 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b832c2e-1b0f-41c1-8f68-f24b2c8a109e service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:44.723950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b832c2e-1b0f-41c1-8f68-f24b2c8a109e service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:44.724235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b832c2e-1b0f-41c1-8f68-f24b2c8a109e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:44.732903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b832c2e-1b0f-41c1-8f68-f24b2c8a109e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:44.765554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b832c2e-1b0f-41c1-8f68-f24b2c8a109e service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:44.775462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 701/1400] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:46.230209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79661cd-5974-42df-b1e8-cdac97ebcf54 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:46.230767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79661cd-5974-42df-b1e8-cdac97ebcf54 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:46.230767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79661cd-5974-42df-b1e8-cdac97ebcf54 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:46.232510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 700/1401] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:03:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:46.237799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d748-5ea8-4b8d-85a9-d7f03f3f8dfd None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:46.238252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d748-5ea8-4b8d-85a9-d7f03f3f8dfd None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:46.238354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4d748-5ea8-4b8d-85a9-d7f03f3f8dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:46.264022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-64d4d748-5ea8-4b8d-85a9-d7f03f3f8dfd None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:46.265185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-64d4d748-5ea8-4b8d-85a9-d7f03f3f8dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:46.272317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 702/1402] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:03:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:03:46.426730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79661cd-5974-42df-b1e8-cdac97ebcf54 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:46.441694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79661cd-5974-42df-b1e8-cdac97ebcf54 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:46.446925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358aa676-9650-4aed-b005-9c94b80a7ff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:46.447545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa676-9650-4aed-b005-9c94b80a7ff8 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:46.447835 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa676-9650-4aed-b005-9c94b80a7ff8 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:46.448117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358aa676-9650-4aed-b005-9c94b80a7ff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:46.456763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aa676-9650-4aed-b005-9c94b80a7ff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:46.484092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358aa676-9650-4aed-b005-9c94b80a7ff8 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:46.494163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 701/1403] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:46 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:47.981775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486441-6894-4238-bacf-3b99b584f655 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:47.982382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486441-6894-4238-bacf-3b99b584f655 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:47.982382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53486441-6894-4238-bacf-3b99b584f655 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:47.984185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 703/1404] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:47.990518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3a0eb-d0da-4e9e-8586-80a6fd8b6a9a None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:47.991065 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3a0eb-d0da-4e9e-8586-80a6fd8b6a9a None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:47.991065 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b3a0eb-d0da-4e9e-8586-80a6fd8b6a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:48.020616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d8b3a0eb-d0da-4e9e-8586-80a6fd8b6a9a None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:48.021990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d8b3a0eb-d0da-4e9e-8586-80a6fd8b6a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:48.031855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 702/1405] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:03:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:03:48.193440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486441-6894-4238-bacf-3b99b584f655 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:48.210255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53486441-6894-4238-bacf-3b99b584f655 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:48.215824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2deeb5-29a1-408e-b5f8-bdf45ae93178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:48.216441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2deeb5-29a1-408e-b5f8-bdf45ae93178 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:48.216727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2deeb5-29a1-408e-b5f8-bdf45ae93178 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:48.217055 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2deeb5-29a1-408e-b5f8-bdf45ae93178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:48.226893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2deeb5-29a1-408e-b5f8-bdf45ae93178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:48.253101 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2deeb5-29a1-408e-b5f8-bdf45ae93178 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:48.263583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 704/1406] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:50.229653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6850a7-407d-4ebd-9cb2-1961b7ac9590 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:50.230201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6850a7-407d-4ebd-9cb2-1961b7ac9590 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:50.230201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6850a7-407d-4ebd-9cb2-1961b7ac9590 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:50.231906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 703/1407] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:50.237252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ec4a-28af-4a47-b6b8-2c10ce2bf306 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:50.237671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ec4a-28af-4a47-b6b8-2c10ce2bf306 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:50.237821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ec4a-28af-4a47-b6b8-2c10ce2bf306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:50.261303 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-51d9ec4a-28af-4a47-b6b8-2c10ce2bf306 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:50.262454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-51d9ec4a-28af-4a47-b6b8-2c10ce2bf306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:50.269391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 705/1408] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:03:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:50.307515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6850a7-407d-4ebd-9cb2-1961b7ac9590 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:50.318632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6850a7-407d-4ebd-9cb2-1961b7ac9590 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:50.322086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e909cd-19a2-4d1e-affe-97265ecc681c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:50.322653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e909cd-19a2-4d1e-affe-97265ecc681c service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:50.322944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e909cd-19a2-4d1e-affe-97265ecc681c service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:50.323226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e909cd-19a2-4d1e-affe-97265ecc681c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:50.331881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e909cd-19a2-4d1e-affe-97265ecc681c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:50.357655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e909cd-19a2-4d1e-affe-97265ecc681c service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:50.367675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 704/1409] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:52.552534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73262885-29cb-4a3e-a6dc-510484067e9d None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:52.552534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73262885-29cb-4a3e-a6dc-510484067e9d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:52.552534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73262885-29cb-4a3e-a6dc-510484067e9d None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:52.552534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 706/1410] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:52.557865 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238970f1-1c11-44e7-9e6a-77d42f1151a7 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:52.558415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238970f1-1c11-44e7-9e6a-77d42f1151a7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:52.558415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238970f1-1c11-44e7-9e6a-77d42f1151a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:52.581377 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-238970f1-1c11-44e7-9e6a-77d42f1151a7 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:52.582517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-238970f1-1c11-44e7-9e6a-77d42f1151a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:52.591010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 705/1411] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:03:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:52.628439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73262885-29cb-4a3e-a6dc-510484067e9d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:52.639750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73262885-29cb-4a3e-a6dc-510484067e9d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:52.643274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babcb42-1493-4c1b-81a9-c35cf85210f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:52.643874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babcb42-1493-4c1b-81a9-c35cf85210f0 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:52.644162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babcb42-1493-4c1b-81a9-c35cf85210f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:52.644440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babcb42-1493-4c1b-81a9-c35cf85210f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:52.654266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babcb42-1493-4c1b-81a9-c35cf85210f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:52.679664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babcb42-1493-4c1b-81a9-c35cf85210f0 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:52.689167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 707/1412] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:55.351372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b44d-45e6-4956-89ec-917bd49f8c82 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:55.352014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b44d-45e6-4956-89ec-917bd49f8c82 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:55.352014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1b44d-45e6-4956-89ec-917bd49f8c82 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:55.353694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 706/1413] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:55.359056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7665993-971f-4c25-8bee-f18498b129ac None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:55.359617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7665993-971f-4c25-8bee-f18498b129ac None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:55.359617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7665993-971f-4c25-8bee-f18498b129ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:55.383185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f7665993-971f-4c25-8bee-f18498b129ac None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:55.384342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f7665993-971f-4c25-8bee-f18498b129ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:55.391254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 708/1414] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:03:55 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:55.430651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b44d-45e6-4956-89ec-917bd49f8c82 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:55.440976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1b44d-45e6-4956-89ec-917bd49f8c82 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:55.444892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaacd5-5133-4396-9410-290cadc303e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:55.445600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaacd5-5133-4396-9410-290cadc303e4 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:55.445896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaacd5-5133-4396-9410-290cadc303e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:55.446183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaacd5-5133-4396-9410-290cadc303e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:55.454978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaacd5-5133-4396-9410-290cadc303e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:55.480413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaacd5-5133-4396-9410-290cadc303e4 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:55.489467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 707/1415] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:55 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:57.641416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adb1ec-0ca9-465a-bc48-fa8fc92fd353 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:57.642016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adb1ec-0ca9-465a-bc48-fa8fc92fd353 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:57.642016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38adb1ec-0ca9-465a-bc48-fa8fc92fd353 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:57.643774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 709/1416] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:57.649293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e6ed-d3cf-4cba-8cbf-366bc0c89c95 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:57.649764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e6ed-d3cf-4cba-8cbf-366bc0c89c95 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:57.649881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e6ed-d3cf-4cba-8cbf-366bc0c89c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:57.672982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-e2e5e6ed-d3cf-4cba-8cbf-366bc0c89c95 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:57.674117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e2e5e6ed-d3cf-4cba-8cbf-366bc0c89c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:57.682110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 708/1417] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:03:57 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:03:57.719981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adb1ec-0ca9-465a-bc48-fa8fc92fd353 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:57.730288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38adb1ec-0ca9-465a-bc48-fa8fc92fd353 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:03:57.733500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384381d-f8e5-4925-9a5b-3dc6edf20231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:03:57.734066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384381d-f8e5-4925-9a5b-3dc6edf20231 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:57.734351 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384381d-f8e5-4925-9a5b-3dc6edf20231 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:57.734632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384381d-f8e5-4925-9a5b-3dc6edf20231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:57.743769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384381d-f8e5-4925-9a5b-3dc6edf20231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:03:57.769269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384381d-f8e5-4925-9a5b-3dc6edf20231 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:03:57.779770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 710/1418] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:03:59.907531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fd41-1349-4601-b299-f8c29f1c9b4f None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:59.908142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fd41-1349-4601-b299-f8c29f1c9b4f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:59.908142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fd41-1349-4601-b299-f8c29f1c9b4f None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:59.909842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 709/1419] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:03:59.915443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae8be-ea46-4492-98db-5644e702896b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:03:59.915953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae8be-ea46-4492-98db-5644e702896b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:03:59.916112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae8be-ea46-4492-98db-5644e702896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:03:59.939532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-bc2ae8be-ea46-4492-98db-5644e702896b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:03:59.940688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-bc2ae8be-ea46-4492-98db-5644e702896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:03:59.948210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 711/1420] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:03:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:03:59.985661 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0fd41-1349-4601-b299-f8c29f1c9b4f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:03:59.997010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0fd41-1349-4601-b299-f8c29f1c9b4f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:00.000383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88232815-1e53-4c4a-ad6c-bce60e32c741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:00.000951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88232815-1e53-4c4a-ad6c-bce60e32c741 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:00.001233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88232815-1e53-4c4a-ad6c-bce60e32c741 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:00.001511 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88232815-1e53-4c4a-ad6c-bce60e32c741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:00.011529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88232815-1e53-4c4a-ad6c-bce60e32c741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:00.037139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88232815-1e53-4c4a-ad6c-bce60e32c741 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:00.047653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 710/1421] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:03:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:02.171652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801df6b-63a1-4ed9-b29c-03d5781a5780 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:02.172219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801df6b-63a1-4ed9-b29c-03d5781a5780 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:02.172219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f801df6b-63a1-4ed9-b29c-03d5781a5780 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:02.173890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 712/1422] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:02.179224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012380-3a1d-487e-8867-b14105c97491 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:02.179714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012380-3a1d-487e-8867-b14105c97491 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:02.179824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8012380-3a1d-487e-8867-b14105c97491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:02.202090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-a8012380-3a1d-487e-8867-b14105c97491 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:02.203227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a8012380-3a1d-487e-8867-b14105c97491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:02.210850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 711/1423] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:04:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:04:02.248917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801df6b-63a1-4ed9-b29c-03d5781a5780 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:02.259800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f801df6b-63a1-4ed9-b29c-03d5781a5780 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:02.262994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7581c6-38a6-4cf1-a73a-c6c81e3a9994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:02.263593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7581c6-38a6-4cf1-a73a-c6c81e3a9994 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:02.263879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7581c6-38a6-4cf1-a73a-c6c81e3a9994 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:02.264156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7581c6-38a6-4cf1-a73a-c6c81e3a9994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:02.273445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7581c6-38a6-4cf1-a73a-c6c81e3a9994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:02.298454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7581c6-38a6-4cf1-a73a-c6c81e3a9994 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:02.308266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 713/1424] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:04.382716 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349876f4-2226-4f4f-9dbe-7a71cd8dccd7 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:04.383239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349876f4-2226-4f4f-9dbe-7a71cd8dccd7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:04.383239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349876f4-2226-4f4f-9dbe-7a71cd8dccd7 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:04.384881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 712/1425] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:04.390144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d2af7-a6f1-44c2-ac81-d8c7bbaf11c7 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:04.390599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d2af7-a6f1-44c2-ac81-d8c7bbaf11c7 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:04.390705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d2af7-a6f1-44c2-ac81-d8c7bbaf11c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:04.414470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-8c2d2af7-a6f1-44c2-ac81-d8c7bbaf11c7 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:04.415651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-8c2d2af7-a6f1-44c2-ac81-d8c7bbaf11c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:04.422680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 714/1426] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:04:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:04:04.460874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349876f4-2226-4f4f-9dbe-7a71cd8dccd7 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:04.471349 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349876f4-2226-4f4f-9dbe-7a71cd8dccd7 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:04.474650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771bc55-75ed-4deb-9ca6-3c42158cba50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:04.476378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771bc55-75ed-4deb-9ca6-3c42158cba50 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:04.476681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771bc55-75ed-4deb-9ca6-3c42158cba50 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:04.477060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771bc55-75ed-4deb-9ca6-3c42158cba50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:04.485679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771bc55-75ed-4deb-9ca6-3c42158cba50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:04.511951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771bc55-75ed-4deb-9ca6-3c42158cba50 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:04.521442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 713/1427] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:04 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:06.557754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b02a-de10-4392-a403-b27f4f27d288 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:06.558329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b02a-de10-4392-a403-b27f4f27d288 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:06.558329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903b02a-de10-4392-a403-b27f4f27d288 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:06.560031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 715/1428] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:06.565501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ee6d6-acf3-4663-b294-806d9e559d68 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:06.565954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ee6d6-acf3-4663-b294-806d9e559d68 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:06.566151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ee6d6-acf3-4663-b294-806d9e559d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:06.589697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-7b7ee6d6-acf3-4663-b294-806d9e559d68 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:06.590846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7b7ee6d6-acf3-4663-b294-806d9e559d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:06.597834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 714/1429] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:04:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:04:06.636131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b02a-de10-4392-a403-b27f4f27d288 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:06.646566 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903b02a-de10-4392-a403-b27f4f27d288 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:06.650397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d05be-ad5a-43e6-97aa-acc71f5ba728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:06.650966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d05be-ad5a-43e6-97aa-acc71f5ba728 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:06.651283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d05be-ad5a-43e6-97aa-acc71f5ba728 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:06.652230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d05be-ad5a-43e6-97aa-acc71f5ba728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:06.660749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d05be-ad5a-43e6-97aa-acc71f5ba728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:06.687978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d05be-ad5a-43e6-97aa-acc71f5ba728 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:06.698788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 716/1430] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:08.766668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cce51-77b3-4f27-96bd-a700237753bd None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:08.767225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cce51-77b3-4f27-96bd-a700237753bd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:08.767225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cce51-77b3-4f27-96bd-a700237753bd None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:08.768951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 715/1431] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:08.774999 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dd33b-8bfc-434a-9cdc-e23bcf6b88e2 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:08.775507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dd33b-8bfc-434a-9cdc-e23bcf6b88e2 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:08.775623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4dd33b-8bfc-434a-9cdc-e23bcf6b88e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:08.798824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-af4dd33b-8bfc-434a-9cdc-e23bcf6b88e2 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:08.800027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-af4dd33b-8bfc-434a-9cdc-e23bcf6b88e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:08.807083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 717/1432] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:04:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:04:08.843814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cce51-77b3-4f27-96bd-a700237753bd None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:08.845475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9c2cce51-77b3-4f27-96bd-a700237753bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:08.858782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cce51-77b3-4f27-96bd-a700237753bd None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:08.862085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19a2b5-88bc-48c6-af37-78803660e908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:08.862652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19a2b5-88bc-48c6-af37-78803660e908 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:08.862940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19a2b5-88bc-48c6-af37-78803660e908 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:08.863227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19a2b5-88bc-48c6-af37-78803660e908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:08.872071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19a2b5-88bc-48c6-af37-78803660e908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:08.898252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19a2b5-88bc-48c6-af37-78803660e908 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:08.907713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 716/1433] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:10.973936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49e87-8293-40b8-aa93-06161f422bfb None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:10.974474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49e87-8293-40b8-aa93-06161f422bfb None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:10.974589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49e87-8293-40b8-aa93-06161f422bfb None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:10.977382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 718/1434] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:10.982774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6733c7e-4617-4d71-9e58-e46d5e6492c8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:10.983233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6733c7e-4617-4d71-9e58-e46d5e6492c8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:10.983388 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6733c7e-4617-4d71-9e58-e46d5e6492c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:11.005625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b6733c7e-4617-4d71-9e58-e46d5e6492c8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:11.006753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b6733c7e-4617-4d71-9e58-e46d5e6492c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:11.013615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 717/1435] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:04:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:04:11.054868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a49e87-8293-40b8-aa93-06161f422bfb None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:11.065746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a49e87-8293-40b8-aa93-06161f422bfb None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:11.069152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09230074-69c1-4745-b9ad-68ad882662a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:11.069750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09230074-69c1-4745-b9ad-68ad882662a6 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:11.070070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09230074-69c1-4745-b9ad-68ad882662a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:11.070350 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09230074-69c1-4745-b9ad-68ad882662a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:11.079428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09230074-69c1-4745-b9ad-68ad882662a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:11.106081 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09230074-69c1-4745-b9ad-68ad882662a6 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:11.116179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 719/1436] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:23.020852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521b7f9-5e06-48c0-a828-12239b7b459d None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:23.021411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521b7f9-5e06-48c0-a828-12239b7b459d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:23.021411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521b7f9-5e06-48c0-a828-12239b7b459d None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:23.023728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 718/1437] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:04:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:23.029317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28877a15-6bfb-40ac-bb72-51f8aab6f2b1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:23.029788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28877a15-6bfb-40ac-bb72-51f8aab6f2b1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:23.029886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28877a15-6bfb-40ac-bb72-51f8aab6f2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:23.053521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-28877a15-6bfb-40ac-bb72-51f8aab6f2b1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:23.054719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-28877a15-6bfb-40ac-bb72-51f8aab6f2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:23.061971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 720/1438] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:04:23.108594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521b7f9-5e06-48c0-a828-12239b7b459d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:23.119891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521b7f9-5e06-48c0-a828-12239b7b459d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:23.123338 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1f196-d68b-4148-b4a3-014b1f9742a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aecbdda2f524fbca580d99b3001bed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:23.123928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f196-d68b-4148-b4a3-014b1f9742a5 service glance] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:23.124218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f196-d68b-4148-b4a3-014b1f9742a5 service glance] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:23.124499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f196-d68b-4148-b4a3-014b1f9742a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:23.133514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1f196-d68b-4148-b4a3-014b1f9742a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:23.159036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1f196-d68b-4148-b4a3-014b1f9742a5 service glance] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:23.169096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 719/1439] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:25.238567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b2772-cd6b-415f-93c0-5fca535e0884 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:25.239106 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b2772-cd6b-415f-93c0-5fca535e0884 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:25.239342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b2772-cd6b-415f-93c0-5fca535e0884 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:25.240930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 721/1440] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:25.246888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2b5b-3c0e-4131-877c-0f30e316fe08 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:25.247333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2b5b-3c0e-4131-877c-0f30e316fe08 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:25.247489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede2b5b-3c0e-4131-877c-0f30e316fe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:25.271610 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-cede2b5b-3c0e-4131-877c-0f30e316fe08 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:25.272738 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-cede2b5b-3c0e-4131-877c-0f30e316fe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:25.279703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 720/1441] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:04:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:04:25.301725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b2772-cd6b-415f-93c0-5fca535e0884 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:25.314231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b2772-cd6b-415f-93c0-5fca535e0884 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:25.318468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b9eeb-799e-4e23-a90b-0e0ae38c086d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:25.319044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b9eeb-799e-4e23-a90b-0e0ae38c086d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:25.319366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b9eeb-799e-4e23-a90b-0e0ae38c086d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:25.320439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b9eeb-799e-4e23-a90b-0e0ae38c086d admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:25.321149 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b9eeb-799e-4e23-a90b-0e0ae38c086d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:25.346372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66b9eeb-799e-4e23-a90b-0e0ae38c086d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:25.361919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 722/1442] 10.222.0.87 () {56 vars in 1108 bytes} [Tue Jan 18 13:04:25 2022] GET /identity/v3/projects => generated 2553 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:04:26.897372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a26fa-5c32-499f-bde4-a61d7d1c562e None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:26.898494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a26fa-5c32-499f-bde4-a61d7d1c562e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:26.898494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a26fa-5c32-499f-bde4-a61d7d1c562e None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:26.900379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 721/1443] 10.222.0.87 () {54 vars in 911 bytes} [Tue Jan 18 13:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:26.905322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ebcf0-42d2-41f8-94b7-b725abd142f8 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:26.905777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ebcf0-42d2-41f8-94b7-b725abd142f8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:26.905894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ebcf0-42d2-41f8-94b7-b725abd142f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:26.928412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-841ebcf0-42d2-41f8-94b7-b725abd142f8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:26.929551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-841ebcf0-42d2-41f8-94b7-b725abd142f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:26.936454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 723/1444] 10.222.0.87 () {58 vars in 1008 bytes} [Tue Jan 18 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:04:27.084784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a26fa-5c32-499f-bde4-a61d7d1c562e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:27.101353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a26fa-5c32-499f-bde4-a61d7d1c562e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:27.107284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e3448-1a41-448f-89fb-a369fe71e0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:27.107939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3448-1a41-448f-89fb-a369fe71e0a4 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:27.108300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3448-1a41-448f-89fb-a369fe71e0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:27.108634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3448-1a41-448f-89fb-a369fe71e0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:27.118160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e3448-1a41-448f-89fb-a369fe71e0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:27.144518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e3448-1a41-448f-89fb-a369fe71e0a4 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:27.154593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 722/1445] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:27 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:29.230295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4954f5-3f9d-494e-9b40-1e92b0ef79b1 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:29.231186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4954f5-3f9d-494e-9b40-1e92b0ef79b1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:29.231950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4954f5-3f9d-494e-9b40-1e92b0ef79b1 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:29.233661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 724/1446] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:04:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:29.239188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239e4b-a2ce-4f44-ab86-0dbbaad5f79b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:29.239736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239e4b-a2ce-4f44-ab86-0dbbaad5f79b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:29.239856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239e4b-a2ce-4f44-ab86-0dbbaad5f79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:29.263449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-0b239e4b-a2ce-4f44-ab86-0dbbaad5f79b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:29.264612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0b239e4b-a2ce-4f44-ab86-0dbbaad5f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:29.271616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 723/1447] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:04:29.308583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4954f5-3f9d-494e-9b40-1e92b0ef79b1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:29.319268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4954f5-3f9d-494e-9b40-1e92b0ef79b1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:29.323801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617a4da-2892-4154-8da0-d628cc89821a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:29.324387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617a4da-2892-4154-8da0-d628cc89821a service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:29.324673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617a4da-2892-4154-8da0-d628cc89821a service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:29.324958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617a4da-2892-4154-8da0-d628cc89821a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:29.334261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617a4da-2892-4154-8da0-d628cc89821a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:29.361089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617a4da-2892-4154-8da0-d628cc89821a service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:29.371699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 725/1448] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:29 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:31.440325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168112e-caf5-4839-bda2-4b1dc5f6e332 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:31.440852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168112e-caf5-4839-bda2-4b1dc5f6e332 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:31.440852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168112e-caf5-4839-bda2-4b1dc5f6e332 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:31.442470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 724/1449] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:31.448501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21007f-0426-40c1-95f5-8adbda2a0dfd None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:31.448960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21007f-0426-40c1-95f5-8adbda2a0dfd None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:31.449065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21007f-0426-40c1-95f5-8adbda2a0dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:31.471710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-ac21007f-0426-40c1-95f5-8adbda2a0dfd None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:31.472864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ac21007f-0426-40c1-95f5-8adbda2a0dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:31.480952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 726/1450] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:04:31.519112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168112e-caf5-4839-bda2-4b1dc5f6e332 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:31.529985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168112e-caf5-4839-bda2-4b1dc5f6e332 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:31.533226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2700009-ef25-49d9-999a-06c4be41000a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:31.533812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2700009-ef25-49d9-999a-06c4be41000a service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:31.534104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2700009-ef25-49d9-999a-06c4be41000a service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:31.534416 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2700009-ef25-49d9-999a-06c4be41000a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:31.556311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2700009-ef25-49d9-999a-06c4be41000a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:31.586082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2700009-ef25-49d9-999a-06c4be41000a service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:31.596373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 725/1451] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:31 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:33.863076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c714d-dc77-4409-bde0-3e8813c3b26f None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:33.863671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c714d-dc77-4409-bde0-3e8813c3b26f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:33.863671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c714d-dc77-4409-bde0-3e8813c3b26f None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:33.865348 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 727/1452] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:33.871788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4065ba-9f84-4397-8a9a-38957befcbfc None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:33.872232 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4065ba-9f84-4397-8a9a-38957befcbfc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:33.872344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4065ba-9f84-4397-8a9a-38957befcbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:33.894715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ae4065ba-9f84-4397-8a9a-38957befcbfc None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:33.895868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ae4065ba-9f84-4397-8a9a-38957befcbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:33.903855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 726/1453] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:04:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:04:33.944014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c714d-dc77-4409-bde0-3e8813c3b26f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:33.954328 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c714d-dc77-4409-bde0-3e8813c3b26f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:33.957584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c99d-8656-4c62-840d-d665e7217f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:33.958152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c99d-8656-4c62-840d-d665e7217f51 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:33.958440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c99d-8656-4c62-840d-d665e7217f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:33.958721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c99d-8656-4c62-840d-d665e7217f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:33.967371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99c99d-8656-4c62-840d-d665e7217f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:33.993754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99c99d-8656-4c62-840d-d665e7217f51 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:34.003109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 728/1454] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:04:36.507460 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4942a-8760-4196-ad63-9af271511bbe None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:36.508306 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4942a-8760-4196-ad63-9af271511bbe None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:36.508602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4942a-8760-4196-ad63-9af271511bbe None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:36.510321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 727/1455] 10.222.0.87 () {54 vars in 926 bytes} [Tue Jan 18 13:04:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:04:36.516339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035ad7c-fa05-45c6-912b-99de8dd5e9c8 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:36.516967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035ad7c-fa05-45c6-912b-99de8dd5e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:36.516967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035ad7c-fa05-45c6-912b-99de8dd5e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:36.540852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f035ad7c-fa05-45c6-912b-99de8dd5e9c8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:04:36.542076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f035ad7c-fa05-45c6-912b-99de8dd5e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:04:36.549223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 729/1456] 10.222.0.87 () {58 vars in 1023 bytes} [Tue Jan 18 13:04:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:04:36.588726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4942a-8760-4196-ad63-9af271511bbe None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:04:36.599671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4942a-8760-4196-ad63-9af271511bbe None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:04:36.603191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfece0c4-d7e6-48de-a9c6-d320429fb514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:04:36.603817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfece0c4-d7e6-48de-a9c6-d320429fb514 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:04:36.604105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfece0c4-d7e6-48de-a9c6-d320429fb514 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:04:36.604383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfece0c4-d7e6-48de-a9c6-d320429fb514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:04:36.613957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfece0c4-d7e6-48de-a9c6-d320429fb514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:04:36.640578 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfece0c4-d7e6-48de-a9c6-d320429fb514 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:04:36.651127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 728/1457] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:04:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:05:52.469829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc828dd-a298-467d-b62c-2513102798bf None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:52.470392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc828dd-a298-467d-b62c-2513102798bf None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:52.470392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc828dd-a298-467d-b62c-2513102798bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:52.492626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-afc828dd-a298-467d-b62c-2513102798bf None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:05:52.493753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-afc828dd-a298-467d-b62c-2513102798bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:05:52.501482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 730/1458] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:05:52.510937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d083c45-6cdf-429e-9f05-c73da343560e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:52.511533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d083c45-6cdf-429e-9f05-c73da343560e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:52.511638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d083c45-6cdf-429e-9f05-c73da343560e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:52.534937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-0d083c45-6cdf-429e-9f05-c73da343560e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:05:52.536168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0d083c45-6cdf-429e-9f05-c73da343560e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:05:52.543786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 729/1459] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:05:52.548580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc828dd-a298-467d-b62c-2513102798bf None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:05:52.557750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc828dd-a298-467d-b62c-2513102798bf None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:05:52.562686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eeb63-33c9-4655-b336-19c5e3ea24d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:05:52.563276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eeb63-33c9-4655-b336-19c5e3ea24d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:52.563597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eeb63-33c9-4655-b336-19c5e3ea24d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:52.563886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8eeb63-33c9-4655-b336-19c5e3ea24d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:52.564569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eeb63-33c9-4655-b336-19c5e3ea24d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:05:52.564866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eeb63-33c9-4655-b336-19c5e3ea24d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:05:52.590635 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8eeb63-33c9-4655-b336-19c5e3ea24d4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:05:52.605906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 731/1460] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:05:52.618834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d083c45-6cdf-429e-9f05-c73da343560e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:05:52.629073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d083c45-6cdf-429e-9f05-c73da343560e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:05:52.633336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99ab4-b35d-481d-a300-e9fbaf29cf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:05:52.633952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99ab4-b35d-481d-a300-e9fbaf29cf87 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:52.634350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99ab4-b35d-481d-a300-e9fbaf29cf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:52.634639 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b99ab4-b35d-481d-a300-e9fbaf29cf87 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:52.635283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b99ab4-b35d-481d-a300-e9fbaf29cf87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:05:52.662115 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b99ab4-b35d-481d-a300-e9fbaf29cf87 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:05:52.781947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 730/1461] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:05:52 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:05:52.786900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eeb63-33c9-4655-b336-19c5e3ea24d4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:05:52.797531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8eeb63-33c9-4655-b336-19c5e3ea24d4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:05:52.862895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57aa2d-7cab-4e30-b652-79cb4b039b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:05:52.863609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57aa2d-7cab-4e30-b652-79cb4b039b25 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:52.863894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57aa2d-7cab-4e30-b652-79cb4b039b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:52.864175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57aa2d-7cab-4e30-b652-79cb4b039b25 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:52.864807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57aa2d-7cab-4e30-b652-79cb4b039b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:05:52.890775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57aa2d-7cab-4e30-b652-79cb4b039b25 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:05:52.985514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 732/1462] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:05:52 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:05:52.989880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99ab4-b35d-481d-a300-e9fbaf29cf87 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:05:52.999971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b99ab4-b35d-481d-a300-e9fbaf29cf87 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:05:53.004196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88384782-72a5-4ecf-b06a-9982ad30ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:05:53.004781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384782-72a5-4ecf-b06a-9982ad30ed1f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:53.005091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384782-72a5-4ecf-b06a-9982ad30ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:53.005367 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88384782-72a5-4ecf-b06a-9982ad30ed1f admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:53.006099 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88384782-72a5-4ecf-b06a-9982ad30ed1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:05:53.032564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88384782-72a5-4ecf-b06a-9982ad30ed1f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:05:53.044031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 731/1463] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:05:53.048434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57aa2d-7cab-4e30-b652-79cb4b039b25 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:05:53.057864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57aa2d-7cab-4e30-b652-79cb4b039b25 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:05:53.062238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384f0a-1b57-46a6-8dc8-6371df5319a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:05:53.063043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384f0a-1b57-46a6-8dc8-6371df5319a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:53.063412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384f0a-1b57-46a6-8dc8-6371df5319a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:53.063623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384f0a-1b57-46a6-8dc8-6371df5319a8 admin admin] PATH_INFO: `/v3/projects/3f3aba25671249799be8ba61cc954d43/users/e80aaf944fd74353b957f8484f3ab334/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:53.083351 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78384f0a-1b57-46a6-8dc8-6371df5319a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3aba25671249799be8ba61cc954d43, user_id=e80aaf944fd74353b957f8484f3ab334, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:05:53.110702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78384f0a-1b57-46a6-8dc8-6371df5319a8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:05:53.259682 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 733/1464] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:05:53 2022] PUT /identity/v3/projects/3f3aba25671249799be8ba61cc954d43/users/e80aaf944fd74353b957f8484f3ab334/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:05:53.271371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeccde-4e6d-40d9-bbc0-e0f1a52c8929 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:53.271671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeccde-4e6d-40d9-bbc0-e0f1a52c8929 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:53.271959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeccde-4e6d-40d9-bbc0-e0f1a52c8929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:53.309755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-9ffeccde-4e6d-40d9-bbc0-e0f1a52c8929 None None] MFA Rules not processed for user `e80aaf944fd74353b957f8484f3ab334`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:05:53.310815 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9ffeccde-4e6d-40d9-bbc0-e0f1a52c8929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:05:53.380833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 732/1465] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:05:53 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:05:53.391881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384f0a-1b57-46a6-8dc8-6371df5319a8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:05:53.468024 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384f0a-1b57-46a6-8dc8-6371df5319a8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:05:53.473304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475515c-682f-4560-8a9e-257f60141c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:05:53.473899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475515c-682f-4560-8a9e-257f60141c90 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:53.474160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475515c-682f-4560-8a9e-257f60141c90 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:53.474445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475515c-682f-4560-8a9e-257f60141c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:53.483368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475515c-682f-4560-8a9e-257f60141c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:05:53.509936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475515c-682f-4560-8a9e-257f60141c90 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:05:53.520015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 734/1466] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:05:53 2022] GET /identity/v3/auth/tokens => generated 3686 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:05:53.598437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e29fb-b1e6-4071-8d5e-17c5ac7e349d None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:53.598834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e29fb-b1e6-4071-8d5e-17c5ac7e349d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:53.599029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e29fb-b1e6-4071-8d5e-17c5ac7e349d None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:53.600670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 733/1467] 10.222.0.87 () {52 vars in 829 bytes} [Tue Jan 18 13:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:05:53.604346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475515c-682f-4560-8a9e-257f60141c90 service nova] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:05:53.673627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475515c-682f-4560-8a9e-257f60141c90 service nova] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:05:53.677766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:05:53.678571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:53.678855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:53.679130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] PATH_INFO: `/v3/users/e80aaf944fd74353b957f8484f3ab334` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:53.680242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80aaf944fd74353b957f8484f3ab334)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:05:53.705482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 13:05:53.705482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 13:05:53.705482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 13:05:53.706670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:05:53.940339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80aaf944fd74353b957f8484f3ab334'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:53.941042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80aaf944fd74353b957f8484f3ab334'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:53.951375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80aaf944fd74353b957f8484f3ab334'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:53.967574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80aaf944fd74353b957f8484f3ab334'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:54.076334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80aaf944fd74353b957f8484f3ab334'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:54.082893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 735/1468] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:05:53 2022] DELETE /identity/v3/users/e80aaf944fd74353b957f8484f3ab334 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:05:54.087418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc938d-9ba4-41e3-913c-192e61d0b816 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:54.087711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc938d-9ba4-41e3-913c-192e61d0b816 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:54.087991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc938d-9ba4-41e3-913c-192e61d0b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:54.111482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-85dc938d-9ba4-41e3-913c-192e61d0b816 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:05:54.111700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-85dc938d-9ba4-41e3-913c-192e61d0b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:05:54.176744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 734/1469] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:05:54 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:05:54.187170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:05:54.188547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:05:54.254264 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4c3c4-a109-4a52-b9e7-c0ad8c8d5dc5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:05:54.257608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c26ea76-e47e-4c45-9b97-cdce98c86a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:05:54.258194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26ea76-e47e-4c45-9b97-cdce98c86a29 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:54.258482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26ea76-e47e-4c45-9b97-cdce98c86a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:54.258767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c26ea76-e47e-4c45-9b97-cdce98c86a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:54.267656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26ea76-e47e-4c45-9b97-cdce98c86a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:05:54.293346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c26ea76-e47e-4c45-9b97-cdce98c86a29 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:05:54.302550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 736/1470] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:05:54 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:05:54.884790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc938d-9ba4-41e3-913c-192e61d0b816 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:05:54.887008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-85dc938d-9ba4-41e3-913c-192e61d0b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:05:54.899208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc938d-9ba4-41e3-913c-192e61d0b816 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:05:54.904606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:05:54.905404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:05:54.905690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:05:54.905979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] PATH_INFO: `/v3/projects/3f3aba25671249799be8ba61cc954d43` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:05:54.907072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3aba25671249799be8ba61cc954d43)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:05:54.933428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 13:05:54.933428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 13:05:54.933428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 13:05:54.934598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:05:55.065366 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3aba25671249799be8ba61cc954d43', 'request_id': 'req-f35aa447-5764-44c3-bc49-6a891027b567'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:55.145171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3aba25671249799be8ba61cc954d43', 'request_id': 'req-f35aa447-5764-44c3-bc49-6a891027b567'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:55.159870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3aba25671249799be8ba61cc954d43', 'request_id': 'req-f35aa447-5764-44c3-bc49-6a891027b567'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:55.170400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] The token cache is being invalidate because project 3f3aba25671249799be8ba61cc954d43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:05:55.170684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:55.171346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f35aa447-5764-44c3-bc49-6a891027b567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:05:55.172952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 735/1471] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:05:54 2022] DELETE /identity/v3/projects/3f3aba25671249799be8ba61cc954d43 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:07:25.191714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f17214-d276-4949-9ddc-85509f7ed35d None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:25.192340 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f17214-d276-4949-9ddc-85509f7ed35d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:25.192340 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f17214-d276-4949-9ddc-85509f7ed35d None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:25.193967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 737/1472] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:25.199766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0437c-e3e3-4c38-aea1-837ab4015b59 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:25.200271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0437c-e3e3-4c38-aea1-837ab4015b59 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:25.200385 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0437c-e3e3-4c38-aea1-837ab4015b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:25.223360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d4c0437c-e3e3-4c38-aea1-837ab4015b59 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:25.224515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d4c0437c-e3e3-4c38-aea1-837ab4015b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:25.306864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 736/1473] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:07:25.456896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f17214-d276-4949-9ddc-85509f7ed35d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:07:25.458590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b9f17214-d276-4949-9ddc-85509f7ed35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:25.541162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f17214-d276-4949-9ddc-85509f7ed35d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:07:25.546156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb4c3f-c737-4a46-ba42-134a98f476f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:07:25.546741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb4c3f-c737-4a46-ba42-134a98f476f5 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:25.547034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb4c3f-c737-4a46-ba42-134a98f476f5 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:25.547321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb4c3f-c737-4a46-ba42-134a98f476f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:25.559441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb4c3f-c737-4a46-ba42-134a98f476f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:07:25.585621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb4c3f-c737-4a46-ba42-134a98f476f5 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:07:25.598894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 738/1474] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:07:25 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:07:26.973154 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f382ea9-52de-424c-bf85-1ae8b48536f6 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:26.973707 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f382ea9-52de-424c-bf85-1ae8b48536f6 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:26.973707 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f382ea9-52de-424c-bf85-1ae8b48536f6 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:26.975364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 737/1475] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:26.981389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbba18-ba84-4ba7-9a26-787a738eeb59 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:26.981895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbba18-ba84-4ba7-9a26-787a738eeb59 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:26.982015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfbba18-ba84-4ba7-9a26-787a738eeb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:27.006316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-8cfbba18-ba84-4ba7-9a26-787a738eeb59 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:27.007502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-8cfbba18-ba84-4ba7-9a26-787a738eeb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:27.014654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 739/1476] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:07:26 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:07:27.169267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f382ea9-52de-424c-bf85-1ae8b48536f6 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:07:27.183546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f382ea9-52de-424c-bf85-1ae8b48536f6 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:07:27.188355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c864c9-b9d0-4125-b483-727a8da8607c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:07:27.188934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c864c9-b9d0-4125-b483-727a8da8607c service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:27.189221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c864c9-b9d0-4125-b483-727a8da8607c service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:27.189502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c864c9-b9d0-4125-b483-727a8da8607c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:27.197701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c864c9-b9d0-4125-b483-727a8da8607c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:07:27.227951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c864c9-b9d0-4125-b483-727a8da8607c service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:07:27.238620 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 738/1477] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:07:27 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:07:27.521166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e034-dd4d-4708-be4d-4d9fb693e61a None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:27.521458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e034-dd4d-4708-be4d-4d9fb693e61a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:27.521747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e034-dd4d-4708-be4d-4d9fb693e61a None None] PATH_INFO: `/v3` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:27.522955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 740/1478] 10.222.0.91 () {54 vars in 925 bytes} [Tue Jan 18 13:07:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:07:27.531958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72009e7c-656a-4d22-9fb7-82417fca7d67 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:27.532318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72009e7c-656a-4d22-9fb7-82417fca7d67 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:27.532890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72009e7c-656a-4d22-9fb7-82417fca7d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:27.558139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-72009e7c-656a-4d22-9fb7-82417fca7d67 None None] MFA Rules not processed for user `0a678f789e3549a3b634acc510c5d0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:27.559813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-72009e7c-656a-4d22-9fb7-82417fca7d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:27.631656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 739/1479] 10.222.0.91 () {58 vars in 1015 bytes} [Tue Jan 18 13:07:27 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:07:37.744670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8ec0d-3b28-40e1-81f4-f60959e1c5a0 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:37.745275 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8ec0d-3b28-40e1-81f4-f60959e1c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:37.745275 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8ec0d-3b28-40e1-81f4-f60959e1c5a0 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:37.746894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 741/1480] 10.222.0.87 () {54 vars in 960 bytes} [Tue Jan 18 13:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:37.751955 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8ba4-a627-474a-ab33-be593654db0f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:37.752445 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8ba4-a627-474a-ab33-be593654db0f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:37.752600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf8ba4-a627-474a-ab33-be593654db0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:37.776240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-15bf8ba4-a627-474a-ab33-be593654db0f None None] MFA Rules not processed for user `0a678f789e3549a3b634acc510c5d0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:37.777373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-15bf8ba4-a627-474a-ab33-be593654db0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:37.785904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 740/1481] 10.222.0.87 () {58 vars in 1057 bytes} [Tue Jan 18 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:07:37.793926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8ec0d-3b28-40e1-81f4-f60959e1c5a0 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:07:37.807495 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8ec0d-3b28-40e1-81f4-f60959e1c5a0 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:07:37.812093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b03bb-ae35-4a13-be22-26445ae6b46d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:07:37.814239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b03bb-ae35-4a13-be22-26445ae6b46d service placement] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:37.814548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b03bb-ae35-4a13-be22-26445ae6b46d service placement] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:37.814822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b03bb-ae35-4a13-be22-26445ae6b46d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:37.824677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b03bb-ae35-4a13-be22-26445ae6b46d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:07:37.850053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b03bb-ae35-4a13-be22-26445ae6b46d service placement] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:07:37.865264 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 742/1482] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:07:37 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:07:39.050250 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b70cd3-b014-426a-8ca4-b4059354640b None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:39.050818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b70cd3-b014-426a-8ca4-b4059354640b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:39.050818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b70cd3-b014-426a-8ca4-b4059354640b None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:39.052633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 741/1483] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:39.059147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0bbb0-657f-4904-944d-d5bdfdfc56ca None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:39.059749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0bbb0-657f-4904-944d-d5bdfdfc56ca None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:39.059749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0bbb0-657f-4904-944d-d5bdfdfc56ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:39.084279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c5a0bbb0-657f-4904-944d-d5bdfdfc56ca None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:39.085433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c5a0bbb0-657f-4904-944d-d5bdfdfc56ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:39.093232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 743/1484] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:07:39.244201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b70cd3-b014-426a-8ca4-b4059354640b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:07:39.257687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b70cd3-b014-426a-8ca4-b4059354640b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:07:39.263318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe375e-65f1-4934-9ccd-655a8a19e229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:07:39.263908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe375e-65f1-4934-9ccd-655a8a19e229 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:39.264201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe375e-65f1-4934-9ccd-655a8a19e229 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:39.264484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe375e-65f1-4934-9ccd-655a8a19e229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:39.272713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe375e-65f1-4934-9ccd-655a8a19e229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:07:39.299347 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe375e-65f1-4934-9ccd-655a8a19e229 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:07:39.309466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 742/1485] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:07:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:07:40.719855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7315d5-9245-48f0-8c2d-00d08a565330 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:40.720433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7315d5-9245-48f0-8c2d-00d08a565330 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:40.720433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7315d5-9245-48f0-8c2d-00d08a565330 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:40.722108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 744/1486] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jan 18 13:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:40.726845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87fee3-1fa1-42a9-8dcf-dd77cca43c42 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:40.727643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87fee3-1fa1-42a9-8dcf-dd77cca43c42 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:40.727936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87fee3-1fa1-42a9-8dcf-dd77cca43c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:40.750538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ef87fee3-1fa1-42a9-8dcf-dd77cca43c42 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:40.751728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ef87fee3-1fa1-42a9-8dcf-dd77cca43c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:40.759368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 743/1487] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jan 18 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:07:40.909620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7315d5-9245-48f0-8c2d-00d08a565330 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:07:40.924518 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7315d5-9245-48f0-8c2d-00d08a565330 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:07:40.929496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bc17f-22fe-446b-a14f-59c64fc5b2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:07:40.930614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bc17f-22fe-446b-a14f-59c64fc5b2c9 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:40.930937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bc17f-22fe-446b-a14f-59c64fc5b2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:40.931184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bc17f-22fe-446b-a14f-59c64fc5b2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:40.939859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bc17f-22fe-446b-a14f-59c64fc5b2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:07:40.966525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bc17f-22fe-446b-a14f-59c64fc5b2c9 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:07:40.977010 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 745/1488] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:07:40 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:07:45.062090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279efe-a7d4-486f-aaca-4de139257c3c None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:45.062662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279efe-a7d4-486f-aaca-4de139257c3c None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:45.062662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc279efe-a7d4-486f-aaca-4de139257c3c None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:45.064378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 744/1489] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:45.076595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f492a-3cf0-40f9-ace5-e0bbbdc766f0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:45.077125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f492a-3cf0-40f9-ace5-e0bbbdc766f0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:45.077313 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f492a-3cf0-40f9-ace5-e0bbbdc766f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:45.120424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f08f492a-3cf0-40f9-ace5-e0bbbdc766f0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:45.122422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f08f492a-3cf0-40f9-ace5-e0bbbdc766f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:45.131807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 746/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:07:45 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:07:45.169109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279efe-a7d4-486f-aaca-4de139257c3c None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:07:45.170828 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bc279efe-a7d4-486f-aaca-4de139257c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:45.243951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc279efe-a7d4-486f-aaca-4de139257c3c None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:07:45.247276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04583511-5370-4070-9bfa-1889fd69da29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:07:45.247889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04583511-5370-4070-9bfa-1889fd69da29 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:45.248173 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04583511-5370-4070-9bfa-1889fd69da29 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:45.248446 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04583511-5370-4070-9bfa-1889fd69da29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:45.257630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04583511-5370-4070-9bfa-1889fd69da29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:07:45.284164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04583511-5370-4070-9bfa-1889fd69da29 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:07:45.295198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 745/1491] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:07:45 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:07:47.381210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd63578-381c-4501-b434-49e38fba7d92 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:47.381809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd63578-381c-4501-b434-49e38fba7d92 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:47.381940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd63578-381c-4501-b434-49e38fba7d92 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:47.383853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 747/1492] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:47.389775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefecac7-db22-4c53-b64f-72cacda37de5 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:47.390339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefecac7-db22-4c53-b64f-72cacda37de5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:47.390549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefecac7-db22-4c53-b64f-72cacda37de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:47.415778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-aefecac7-db22-4c53-b64f-72cacda37de5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:47.416984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-aefecac7-db22-4c53-b64f-72cacda37de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:47.424188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 746/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:07:47.465797 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd63578-381c-4501-b434-49e38fba7d92 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:07:47.467516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-8fd63578-381c-4501-b434-49e38fba7d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:47.480562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd63578-381c-4501-b434-49e38fba7d92 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:07:47.483810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1b70f-f764-46cc-a389-fdc8dee253ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:07:47.484390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b70f-f764-46cc-a389-fdc8dee253ea service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:47.484679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b70f-f764-46cc-a389-fdc8dee253ea service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:47.484961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b70f-f764-46cc-a389-fdc8dee253ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:47.495044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1b70f-f764-46cc-a389-fdc8dee253ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:07:47.520561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1b70f-f764-46cc-a389-fdc8dee253ea service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:07:47.531517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 748/1494] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:07:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:07:51.117376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7bc6-62a2-4c85-a3bf-2bc3507938ec None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:51.117875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7bc6-62a2-4c85-a3bf-2bc3507938ec None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:51.118136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd7bc6-62a2-4c85-a3bf-2bc3507938ec None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:51.119815 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 747/1495] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:51.124907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fced60-64f8-4eef-805d-3df84d934502 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:51.125337 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fced60-64f8-4eef-805d-3df84d934502 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:51.125471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fced60-64f8-4eef-805d-3df84d934502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:51.150208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b7fced60-64f8-4eef-805d-3df84d934502 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:51.151266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b7fced60-64f8-4eef-805d-3df84d934502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:51.158643 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 749/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:07:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:07:51.216806 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd7bc6-62a2-4c85-a3bf-2bc3507938ec None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:07:51.218794 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-81dd7bc6-62a2-4c85-a3bf-2bc3507938ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:51.286656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd7bc6-62a2-4c85-a3bf-2bc3507938ec None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:07:51.290179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ca54d-4745-42d8-882d-cf260c3be40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:07:51.290772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca54d-4745-42d8-882d-cf260c3be40e service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:51.291049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca54d-4745-42d8-882d-cf260c3be40e service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:51.291353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca54d-4745-42d8-882d-cf260c3be40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:51.300752 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ca54d-4745-42d8-882d-cf260c3be40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:07:51.327057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ca54d-4745-42d8-882d-cf260c3be40e service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:07:51.336967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 748/1497] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:07:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:07:53.423462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ddb85-6649-486e-8bce-e78b05bc44f7 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:53.424043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ddb85-6649-486e-8bce-e78b05bc44f7 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:53.424043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ddb85-6649-486e-8bce-e78b05bc44f7 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:53.425772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 750/1498] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jan 18 13:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:53.431467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9a602-0cac-47db-a277-7f973fa48ddb None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:53.432003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9a602-0cac-47db-a277-7f973fa48ddb None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:53.432122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9a602-0cac-47db-a277-7f973fa48ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:53.455794 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-dfc9a602-0cac-47db-a277-7f973fa48ddb None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:53.456944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dfc9a602-0cac-47db-a277-7f973fa48ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:53.466920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 749/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jan 18 13:07:53 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:07:53.530699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3b75a-a4db-4844-8852-532c89809e9d None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:53.531003 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3b75a-a4db-4844-8852-532c89809e9d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:53.531265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3b75a-a4db-4844-8852-532c89809e9d None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:53.533407 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 751/1500] 10.222.0.87 () {54 vars in 962 bytes} [Tue Jan 18 13:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:07:53.539586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57fa77-416c-4772-8570-078260a39b16 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:53.539883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57fa77-416c-4772-8570-078260a39b16 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:53.540168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57fa77-416c-4772-8570-078260a39b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:53.569100 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4b57fa77-416c-4772-8570-078260a39b16 None None] MFA Rules not processed for user `f6fb4643e93c455c9eb828c52b68bbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:07:53.570851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4b57fa77-416c-4772-8570-078260a39b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:07:53.577512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 750/1501] 10.222.0.87 () {58 vars in 1059 bytes} [Tue Jan 18 13:07:53 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:07:53.585524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3b75a-a4db-4844-8852-532c89809e9d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:07:53.596808 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3b75a-a4db-4844-8852-532c89809e9d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:07:53.600429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7f29-b0cc-46c5-b8cb-ca4617bdac53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:07:53.601032 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7f29-b0cc-46c5-b8cb-ca4617bdac53 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:07:53.601329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7f29-b0cc-46c5-b8cb-ca4617bdac53 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:07:53.602219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7f29-b0cc-46c5-b8cb-ca4617bdac53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:07:53.612015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7f29-b0cc-46c5-b8cb-ca4617bdac53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:07:53.637408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f7f29-b0cc-46c5-b8cb-ca4617bdac53 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:07:53.649362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 752/1502] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:07:53 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:31.234159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adc2d-5dae-41c5-b219-85f804bcbd8f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.234784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adc2d-5dae-41c5-b219-85f804bcbd8f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.234784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250adc2d-5dae-41c5-b219-85f804bcbd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.268358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-250adc2d-5dae-41c5-b219-85f804bcbd8f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.269539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-250adc2d-5dae-41c5-b219-85f804bcbd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.282303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 751/1503] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:31.292531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7f0f-2355-42c0-ad79-6ae43edad7c1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.293098 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7f0f-2355-42c0-ad79-6ae43edad7c1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.293195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af7f0f-2355-42c0-ad79-6ae43edad7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.322646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a5af7f0f-2355-42c0-ad79-6ae43edad7c1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.327475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a5af7f0f-2355-42c0-ad79-6ae43edad7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.329557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2041c-a963-49d4-a03c-9e375f667d0a None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.329849 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2041c-a963-49d4-a03c-9e375f667d0a None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.330138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2041c-a963-49d4-a03c-9e375f667d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.357238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 753/1504] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:31.362839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7f0f-2355-42c0-ad79-6ae43edad7c1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:31.367240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-bdb2041c-a963-49d4-a03c-9e375f667d0a None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.368629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bdb2041c-a963-49d4-a03c-9e375f667d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.375241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af7f0f-2355-42c0-ad79-6ae43edad7c1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:31.385267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 752/1505] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:31.385865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af98c-a035-4566-bca2-d85ddb6ec07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:31.386738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af98c-a035-4566-bca2-d85ddb6ec07b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.387039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af98c-a035-4566-bca2-d85ddb6ec07b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.387341 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382af98c-a035-4566-bca2-d85ddb6ec07b admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.388058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382af98c-a035-4566-bca2-d85ddb6ec07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:09:31.388360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382af98c-a035-4566-bca2-d85ddb6ec07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:31.393705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281fcb-9921-458e-be91-918c7343f24b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.394030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281fcb-9921-458e-be91-918c7343f24b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.394281 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60281fcb-9921-458e-be91-918c7343f24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.437289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382af98c-a035-4566-bca2-d85ddb6ec07b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:31.446255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-60281fcb-9921-458e-be91-918c7343f24b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.447465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-60281fcb-9921-458e-be91-918c7343f24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.462965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 754/1506] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:09:31.472658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af98c-a035-4566-bca2-d85ddb6ec07b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:31.473387 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 753/1507] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:31.478820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60281fcb-9921-458e-be91-918c7343f24b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:31.484820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382af98c-a035-4566-bca2-d85ddb6ec07b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:31.491418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd76fd-5cd9-45e9-9132-d8703da0da41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:31.492129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd76fd-5cd9-45e9-9132-d8703da0da41 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.492417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60281fcb-9921-458e-be91-918c7343f24b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:31.492612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd76fd-5cd9-45e9-9132-d8703da0da41 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.493000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd76fd-5cd9-45e9-9132-d8703da0da41 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.493831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd76fd-5cd9-45e9-9132-d8703da0da41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:31.511352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b4f8b-6997-46f6-806e-1d4c99aaf25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:31.511352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b4f8b-6997-46f6-806e-1d4c99aaf25b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.511352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b4f8b-6997-46f6-806e-1d4c99aaf25b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.511352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b4f8b-6997-46f6-806e-1d4c99aaf25b admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.511844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b4f8b-6997-46f6-806e-1d4c99aaf25b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:09:31.511844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b4f8b-6997-46f6-806e-1d4c99aaf25b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:31.523728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd76fd-5cd9-45e9-9132-d8703da0da41 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:31.562918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b4f8b-6997-46f6-806e-1d4c99aaf25b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:31.579722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 754/1508] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:09:31.581311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdb168-af31-43e6-a332-6b543bc97799 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.581662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdb168-af31-43e6-a332-6b543bc97799 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.581954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdb168-af31-43e6-a332-6b543bc97799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.607675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d2fdb168-af31-43e6-a332-6b543bc97799 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.608826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d2fdb168-af31-43e6-a332-6b543bc97799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.622148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 755/1509] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:31.622995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdb168-af31-43e6-a332-6b543bc97799 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:31.633594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdb168-af31-43e6-a332-6b543bc97799 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:31.641809 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7330d-7087-46f7-ba6d-566a3e990fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:31.642358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7330d-7087-46f7-ba6d-566a3e990fda admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.642647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7330d-7087-46f7-ba6d-566a3e990fda admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.642930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7330d-7087-46f7-ba6d-566a3e990fda admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.643615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7330d-7087-46f7-ba6d-566a3e990fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:31.666363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 755/1510] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:31.670527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e734e-e827-4c22-971d-c1ce8021739a None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.678452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e734e-e827-4c22-971d-c1ce8021739a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.678452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e734e-e827-4c22-971d-c1ce8021739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.682684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7330d-7087-46f7-ba6d-566a3e990fda admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:31.705302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-023e734e-e827-4c22-971d-c1ce8021739a None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.706536 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-023e734e-e827-4c22-971d-c1ce8021739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.783153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 756/1511] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:31.784655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11d08-7576-45f9-b43c-2d54ed46cca5 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.784951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11d08-7576-45f9-b43c-2d54ed46cca5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.785251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11d08-7576-45f9-b43c-2d54ed46cca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.811026 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-dfc11d08-7576-45f9-b43c-2d54ed46cca5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.812526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-dfc11d08-7576-45f9-b43c-2d54ed46cca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.821009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 756/1512] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:31.821009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7330d-7087-46f7-ba6d-566a3e990fda admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:31.884527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 757/1513] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:31.885902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6f52e-15e6-4a34-9dbe-cb73897d34b2 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.886274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6f52e-15e6-4a34-9dbe-cb73897d34b2 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.886565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6f52e-15e6-4a34-9dbe-cb73897d34b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.890974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7330d-7087-46f7-ba6d-566a3e990fda admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:31.899518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcde453-bd2a-40b9-b7d6-88ddd6a8496b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:31.900532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcde453-bd2a-40b9-b7d6-88ddd6a8496b admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.900828 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcde453-bd2a-40b9-b7d6-88ddd6a8496b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.901105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcde453-bd2a-40b9-b7d6-88ddd6a8496b admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.902497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcde453-bd2a-40b9-b7d6-88ddd6a8496b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:31.913414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-19d6f52e-15e6-4a34-9dbe-cb73897d34b2 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.914591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-19d6f52e-15e6-4a34-9dbe-cb73897d34b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.922054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 758/1514] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:31.924813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fef1e-7950-4aea-afa1-78c1f12be261 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.925173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fef1e-7950-4aea-afa1-78c1f12be261 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.925499 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fef1e-7950-4aea-afa1-78c1f12be261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.930563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcde453-bd2a-40b9-b7d6-88ddd6a8496b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:31.949572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-722fef1e-7950-4aea-afa1-78c1f12be261 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.950813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-722fef1e-7950-4aea-afa1-78c1f12be261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.958209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 759/1515] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:31.961923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa691-7a9c-4d3f-a9f5-2d952aad7072 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.961923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa691-7a9c-4d3f-a9f5-2d952aad7072 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.961923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa691-7a9c-4d3f-a9f5-2d952aad7072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:31.983079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-6b5fa691-7a9c-4d3f-a9f5-2d952aad7072 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:31.984253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-6b5fa691-7a9c-4d3f-a9f5-2d952aad7072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:31.991828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 760/1516] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:31.993131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2571-6721-4f13-860c-d0c79b2ca289 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:31.993423 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2571-6721-4f13-860c-d0c79b2ca289 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:31.993710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2571-6721-4f13-860c-d0c79b2ca289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.017119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-25fd2571-6721-4f13-860c-d0c79b2ca289 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:32.018403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-25fd2571-6721-4f13-860c-d0c79b2ca289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:32.025647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 761/1517] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:32.026503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd2571-6721-4f13-860c-d0c79b2ca289 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.036360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd2571-6721-4f13-860c-d0c79b2ca289 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.041352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 757/1518] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:31 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:32.042779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b30b07-4766-4b96-8c3e-f42eb4196c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.046330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcde453-bd2a-40b9-b7d6-88ddd6a8496b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.046452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b30b07-4766-4b96-8c3e-f42eb4196c7f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.046452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b30b07-4766-4b96-8c3e-f42eb4196c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.046452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b30b07-4766-4b96-8c3e-f42eb4196c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.046452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b30b07-4766-4b96-8c3e-f42eb4196c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:09:32.046452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b30b07-4766-4b96-8c3e-f42eb4196c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.054831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcde453-bd2a-40b9-b7d6-88ddd6a8496b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.059854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c60e4-c0c3-4a06-b2a0-6c1ae9fc1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.060462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c60e4-c0c3-4a06-b2a0-6c1ae9fc1de2 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.060751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c60e4-c0c3-4a06-b2a0-6c1ae9fc1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.061034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c60e4-c0c3-4a06-b2a0-6c1ae9fc1de2 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.061670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c60e4-c0c3-4a06-b2a0-6c1ae9fc1de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.073156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b30b07-4766-4b96-8c3e-f42eb4196c7f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.088108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 762/1519] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:09:32.088581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c60e4-c0c3-4a06-b2a0-6c1ae9fc1de2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.089426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ec75-e5f1-464d-bebe-941a487ddb3c None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.089886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ec75-e5f1-464d-bebe-941a487ddb3c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.090177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33ec75-e5f1-464d-bebe-941a487ddb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.118616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-2a33ec75-e5f1-464d-bebe-941a487ddb3c None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:32.119801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2a33ec75-e5f1-464d-bebe-941a487ddb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:32.126835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 763/1520] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:32.128109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40bbd-2d95-47d7-8322-85cb65da26f4 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.128396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40bbd-2d95-47d7-8322-85cb65da26f4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.128674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d40bbd-2d95-47d7-8322-85cb65da26f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.151852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-93d40bbd-2d95-47d7-8322-85cb65da26f4 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:32.152908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-93d40bbd-2d95-47d7-8322-85cb65da26f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:32.160604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 764/1521] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:32.161815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0ee5-0f94-4192-a744-a4bc0990179a None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.162257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0ee5-0f94-4192-a744-a4bc0990179a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.162583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b0ee5-0f94-4192-a744-a4bc0990179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.188276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-275b0ee5-0f94-4192-a744-a4bc0990179a None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:32.189436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-275b0ee5-0f94-4192-a744-a4bc0990179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:32.192353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 758/1522] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:32.193604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395601-7316-457e-a7a0-41bb907f2792 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.193892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395601-7316-457e-a7a0-41bb907f2792 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.194169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0395601-7316-457e-a7a0-41bb907f2792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.197130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 765/1523] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:32.198353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278f61-16d0-4976-8ce4-9b6b52b547fa None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.198639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278f61-16d0-4976-8ce4-9b6b52b547fa None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.198917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0278f61-16d0-4976-8ce4-9b6b52b547fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.221547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f0278f61-16d0-4976-8ce4-9b6b52b547fa None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:32.221763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f0395601-7316-457e-a7a0-41bb907f2792 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:32.222756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f0278f61-16d0-4976-8ce4-9b6b52b547fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:32.222886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f0395601-7316-457e-a7a0-41bb907f2792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:32.230700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 766/1524] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:32.234546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 759/1525] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:32.234546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395601-7316-457e-a7a0-41bb907f2792 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.235483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278f61-16d0-4976-8ce4-9b6b52b547fa None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.244845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0395601-7316-457e-a7a0-41bb907f2792 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.245120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0278f61-16d0-4976-8ce4-9b6b52b547fa None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.249035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66a8b6-02da-4d35-a764-577e4d4db2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.249428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1335f-9bdc-4965-a084-cd7495e74dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.249626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66a8b6-02da-4d35-a764-577e4d4db2f6 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.249988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66a8b6-02da-4d35-a764-577e4d4db2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.250098 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1335f-9bdc-4965-a084-cd7495e74dcc admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.250271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66a8b6-02da-4d35-a764-577e4d4db2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.250380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1335f-9bdc-4965-a084-cd7495e74dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.250559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1335f-9bdc-4965-a084-cd7495e74dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.250903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66a8b6-02da-4d35-a764-577e4d4db2f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.251242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1335f-9bdc-4965-a084-cd7495e74dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.277038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66a8b6-02da-4d35-a764-577e4d4db2f6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.277416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1335f-9bdc-4965-a084-cd7495e74dcc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.289288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 767/1526] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:32.290175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1335f-9bdc-4965-a084-cd7495e74dcc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.299977 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1335f-9bdc-4965-a084-cd7495e74dcc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.304800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346ade-49ab-4fb6-930f-aa6d9f1cdf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.308623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346ade-49ab-4fb6-930f-aa6d9f1cdf67 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.308623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346ade-49ab-4fb6-930f-aa6d9f1cdf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.308623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346ade-49ab-4fb6-930f-aa6d9f1cdf67 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.308623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97346ade-49ab-4fb6-930f-aa6d9f1cdf67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:09:32.308623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97346ade-49ab-4fb6-930f-aa6d9f1cdf67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.332625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97346ade-49ab-4fb6-930f-aa6d9f1cdf67 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.347466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 768/1527] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:09:32.348477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346ade-49ab-4fb6-930f-aa6d9f1cdf67 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.359461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346ade-49ab-4fb6-930f-aa6d9f1cdf67 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.364235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368c65e-e5bb-4af9-9c5f-9072149da942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.364450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368c65e-e5bb-4af9-9c5f-9072149da942 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.364746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368c65e-e5bb-4af9-9c5f-9072149da942 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.365387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368c65e-e5bb-4af9-9c5f-9072149da942 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.366363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368c65e-e5bb-4af9-9c5f-9072149da942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:09:32.366670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368c65e-e5bb-4af9-9c5f-9072149da942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.392989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368c65e-e5bb-4af9-9c5f-9072149da942 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.402914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 760/1528] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:32.404156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66a8b6-02da-4d35-a764-577e4d4db2f6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.413235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 769/1529] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:09:32.414713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368c65e-e5bb-4af9-9c5f-9072149da942 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.432012 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368c65e-e5bb-4af9-9c5f-9072149da942 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.478829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66a8b6-02da-4d35-a764-577e4d4db2f6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.483646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e185-5e7a-4e22-bfeb-0d1f17b056ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.484250 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e185-5e7a-4e22-bfeb-0d1f17b056ce admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.484545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e185-5e7a-4e22-bfeb-0d1f17b056ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.484881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e185-5e7a-4e22-bfeb-0d1f17b056ce admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.485584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8e185-5e7a-4e22-bfeb-0d1f17b056ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.512532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8e185-5e7a-4e22-bfeb-0d1f17b056ce admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.526778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 761/1530] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:32.528229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e185-5e7a-4e22-bfeb-0d1f17b056ce admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.531954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56657e30-342d-4abc-ad8d-459734097e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.532588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657e30-342d-4abc-ad8d-459734097e25 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.533047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657e30-342d-4abc-ad8d-459734097e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.533322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56657e30-342d-4abc-ad8d-459734097e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.534020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657e30-342d-4abc-ad8d-459734097e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:09:32.534361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657e30-342d-4abc-ad8d-459734097e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.541626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e185-5e7a-4e22-bfeb-0d1f17b056ce admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.545954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fc291-25e8-4320-8f93-098f4b7a8caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.546538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fc291-25e8-4320-8f93-098f4b7a8caa admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.546826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fc291-25e8-4320-8f93-098f4b7a8caa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.547108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fc291-25e8-4320-8f93-098f4b7a8caa admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.547836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fc291-25e8-4320-8f93-098f4b7a8caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:09:32.548140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fc291-25e8-4320-8f93-098f4b7a8caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.561197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56657e30-342d-4abc-ad8d-459734097e25 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.574189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 770/1531] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:09:32.574795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fc291-25e8-4320-8f93-098f4b7a8caa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.575019 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56657e30-342d-4abc-ad8d-459734097e25 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.589279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 762/1532] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:09:32.590093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fc291-25e8-4320-8f93-098f4b7a8caa admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.591006 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56657e30-342d-4abc-ad8d-459734097e25 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.595386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351540-1db8-4117-92b2-7bbbb819444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.595983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351540-1db8-4117-92b2-7bbbb819444d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.596270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351540-1db8-4117-92b2-7bbbb819444d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.596561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68351540-1db8-4117-92b2-7bbbb819444d admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.597250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68351540-1db8-4117-92b2-7bbbb819444d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:09:32.597546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68351540-1db8-4117-92b2-7bbbb819444d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.600521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fc291-25e8-4320-8f93-098f4b7a8caa admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.604802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd489df-6b5d-4ce3-85e5-497a569e27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.605613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd489df-6b5d-4ce3-85e5-497a569e27e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.605894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd489df-6b5d-4ce3-85e5-497a569e27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.606173 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd489df-6b5d-4ce3-85e5-497a569e27e6 admin admin] PATH_INFO: `/v3/projects/88cc4d2f0d824d9fb00fef30d74faf40/users/d4920157781e4b3cba0bd68f2e98ef3a/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.624308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68351540-1db8-4117-92b2-7bbbb819444d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.626401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd489df-6b5d-4ce3-85e5-497a569e27e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cc4d2f0d824d9fb00fef30d74faf40, user_id=d4920157781e4b3cba0bd68f2e98ef3a, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.637561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 771/1533] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:09:32.638353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351540-1db8-4117-92b2-7bbbb819444d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.651071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68351540-1db8-4117-92b2-7bbbb819444d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.653675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd489df-6b5d-4ce3-85e5-497a569e27e6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.656583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087997-f469-4770-9bdd-c19011477a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.657357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087997-f469-4770-9bdd-c19011477a8d admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.657570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087997-f469-4770-9bdd-c19011477a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.657729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c087997-f469-4770-9bdd-c19011477a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.658373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087997-f469-4770-9bdd-c19011477a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.685926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c087997-f469-4770-9bdd-c19011477a8d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.744215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 763/1534] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:32 2022] PUT /identity/v3/projects/88cc4d2f0d824d9fb00fef30d74faf40/users/d4920157781e4b3cba0bd68f2e98ef3a/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:32.745035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd489df-6b5d-4ce3-85e5-497a569e27e6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.823544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 772/1535] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:32.823544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087997-f469-4770-9bdd-c19011477a8d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:32.835728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd489df-6b5d-4ce3-85e5-497a569e27e6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.896067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c087997-f469-4770-9bdd-c19011477a8d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:32.900890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62827d-4a07-4f5a-b35f-a36322a8de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.901480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62827d-4a07-4f5a-b35f-a36322a8de56 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.901768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62827d-4a07-4f5a-b35f-a36322a8de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.902051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62827d-4a07-4f5a-b35f-a36322a8de56 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.902623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf622c-ad11-4afc-8303-cabb18073970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:32.902854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62827d-4a07-4f5a-b35f-a36322a8de56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.903471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf622c-ad11-4afc-8303-cabb18073970 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:32.903931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf622c-ad11-4afc-8303-cabb18073970 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:32.904264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf622c-ad11-4afc-8303-cabb18073970 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:32.905151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf622c-ad11-4afc-8303-cabb18073970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:32.930503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62827d-4a07-4f5a-b35f-a36322a8de56 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:32.931961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf622c-ad11-4afc-8303-cabb18073970 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.025941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 764/1536] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:33.026868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf622c-ad11-4afc-8303-cabb18073970 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.036831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf622c-ad11-4afc-8303-cabb18073970 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.042756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced874d1-8d71-4a43-9a44-a513d8a81b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.043621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced874d1-8d71-4a43-9a44-a513d8a81b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.043916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced874d1-8d71-4a43-9a44-a513d8a81b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.044198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced874d1-8d71-4a43-9a44-a513d8a81b9d admin admin] PATH_INFO: `/v3/projects/a3359b64312a4f06a3f2ac503b2ee164/users/33eabb14bdfd4a70b52101bd2333dc48/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.051559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 773/1537] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:32 2022] POST /identity/v3/projects => generated 367 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:33.052396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62827d-4a07-4f5a-b35f-a36322a8de56 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.070109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced874d1-8d71-4a43-9a44-a513d8a81b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3359b64312a4f06a3f2ac503b2ee164, user_id=33eabb14bdfd4a70b52101bd2333dc48, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.097859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced874d1-8d71-4a43-9a44-a513d8a81b9d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.137636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62827d-4a07-4f5a-b35f-a36322a8de56 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.142235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e97451-613d-4464-b68a-0864898273e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.142840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e97451-613d-4464-b68a-0864898273e0 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.143143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e97451-613d-4464-b68a-0864898273e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.143439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e97451-613d-4464-b68a-0864898273e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.144086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e97451-613d-4464-b68a-0864898273e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.172001 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e97451-613d-4464-b68a-0864898273e0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.183454 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 765/1538] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:33 2022] PUT /identity/v3/projects/a3359b64312a4f06a3f2ac503b2ee164/users/33eabb14bdfd4a70b52101bd2333dc48/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:33.184636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced874d1-8d71-4a43-9a44-a513d8a81b9d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.264012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced874d1-8d71-4a43-9a44-a513d8a81b9d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.272909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357955a-af19-4120-80c6-07fb44848529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.272909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357955a-af19-4120-80c6-07fb44848529 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.272909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357955a-af19-4120-80c6-07fb44848529 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.272909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357955a-af19-4120-80c6-07fb44848529 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.273276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357955a-af19-4120-80c6-07fb44848529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.299123 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357955a-af19-4120-80c6-07fb44848529 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.301398 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 774/1539] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:33.302375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e97451-613d-4464-b68a-0864898273e0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.374105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e97451-613d-4464-b68a-0864898273e0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.378516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9cea8-8558-414f-80da-2a53e4b98cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.379119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9cea8-8558-414f-80da-2a53e4b98cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.379450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9cea8-8558-414f-80da-2a53e4b98cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.379740 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9cea8-8558-414f-80da-2a53e4b98cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.380386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9cea8-8558-414f-80da-2a53e4b98cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.406838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 766/1540] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:33.408319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e907598-c6d8-4cb8-9cb9-c24f5fb9cdb0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.408641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9cea8-8558-414f-80da-2a53e4b98cc8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.408756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e907598-c6d8-4cb8-9cb9-c24f5fb9cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.409079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e907598-c6d8-4cb8-9cb9-c24f5fb9cdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.449663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-2e907598-c6d8-4cb8-9cb9-c24f5fb9cdb0 None None] MFA Rules not processed for user `d4920157781e4b3cba0bd68f2e98ef3a`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:33.450759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-2e907598-c6d8-4cb8-9cb9-c24f5fb9cdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:33.490654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 775/1541] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:33.490654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9cea8-8558-414f-80da-2a53e4b98cc8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.528423 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 767/1542] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:33.529576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e907598-c6d8-4cb8-9cb9-c24f5fb9cdb0 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.565331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9cea8-8558-414f-80da-2a53e4b98cc8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.570903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecd8e8-47d8-467b-a2b6-1023de24e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.571610 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd8e8-47d8-467b-a2b6-1023de24e94a admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.571902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd8e8-47d8-467b-a2b6-1023de24e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.572197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd8e8-47d8-467b-a2b6-1023de24e94a admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.572829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecd8e8-47d8-467b-a2b6-1023de24e94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.599753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecd8e8-47d8-467b-a2b6-1023de24e94a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.606920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e907598-c6d8-4cb8-9cb9-c24f5fb9cdb0 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.612237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c82ac4-38ed-4b60-b31a-fbef073d2e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.612875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c82ac4-38ed-4b60-b31a-fbef073d2e39 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.613164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c82ac4-38ed-4b60-b31a-fbef073d2e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.613462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c82ac4-38ed-4b60-b31a-fbef073d2e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.614149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c82ac4-38ed-4b60-b31a-fbef073d2e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.641027 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c82ac4-38ed-4b60-b31a-fbef073d2e39 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.652192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 768/1543] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:33.652772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c82ac4-38ed-4b60-b31a-fbef073d2e39 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.662482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c82ac4-38ed-4b60-b31a-fbef073d2e39 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.666737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373c13b-6122-4fab-b886-12bb5d0061f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.667347 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373c13b-6122-4fab-b886-12bb5d0061f8 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.667641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373c13b-6122-4fab-b886-12bb5d0061f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.667924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373c13b-6122-4fab-b886-12bb5d0061f8 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.668557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373c13b-6122-4fab-b886-12bb5d0061f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.695688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373c13b-6122-4fab-b886-12bb5d0061f8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.730046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 776/1544] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:33.730046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe0bc-1de0-45ff-95a0-ee372862b229 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.730046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe0bc-1de0-45ff-95a0-ee372862b229 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.730046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fe0bc-1de0-45ff-95a0-ee372862b229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.752443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-881fe0bc-1de0-45ff-95a0-ee372862b229 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:33.753598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-881fe0bc-1de0-45ff-95a0-ee372862b229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:33.761795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 777/1545] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:33.762596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe0bc-1de0-45ff-95a0-ee372862b229 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.771941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fe0bc-1de0-45ff-95a0-ee372862b229 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.776419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671836fb-2bce-4d52-a024-235f73d002c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.777020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671836fb-2bce-4d52-a024-235f73d002c6 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.777312 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671836fb-2bce-4d52-a024-235f73d002c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.777596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671836fb-2bce-4d52-a024-235f73d002c6 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.778230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671836fb-2bce-4d52-a024-235f73d002c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.805816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671836fb-2bce-4d52-a024-235f73d002c6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.814629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 769/1546] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:33.814629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373c13b-6122-4fab-b886-12bb5d0061f8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.822974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373c13b-6122-4fab-b886-12bb5d0061f8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.827470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02c8fc-c30a-4382-8d23-9f27088f60a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.828077 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c8fc-c30a-4382-8d23-9f27088f60a5 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.828384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c8fc-c30a-4382-8d23-9f27088f60a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.828649 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c8fc-c30a-4382-8d23-9f27088f60a5 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.829340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02c8fc-c30a-4382-8d23-9f27088f60a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.855689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02c8fc-c30a-4382-8d23-9f27088f60a5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:33.963421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 778/1547] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:33.963421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671836fb-2bce-4d52-a024-235f73d002c6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.964105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 770/1548] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:33.964105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420987ad-f332-4bf2-9140-5fdc46a422ba None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.964105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420987ad-f332-4bf2-9140-5fdc46a422ba None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.964105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420987ad-f332-4bf2-9140-5fdc46a422ba None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.965677 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 771/1549] 10.222.0.87 () {54 vars in 959 bytes} [Tue Jan 18 13:09:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:09:33.966767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420987ad-f332-4bf2-9140-5fdc46a422ba None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:33.974299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671836fb-2bce-4d52-a024-235f73d002c6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.980226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420987ad-f332-4bf2-9140-5fdc46a422ba None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:33.981440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a40f44-5a4b-4f9c-b91d-4bf7c1b8991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.982345 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a40f44-5a4b-4f9c-b91d-4bf7c1b8991b admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.982648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a40f44-5a4b-4f9c-b91d-4bf7c1b8991b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.982931 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a40f44-5a4b-4f9c-b91d-4bf7c1b8991b admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:33.983632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a40f44-5a4b-4f9c-b91d-4bf7c1b8991b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:33.987657 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78087f77-a318-4896-80fe-799f81eb39e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:33.989094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087f77-a318-4896-80fe-799f81eb39e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:33.989379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087f77-a318-4896-80fe-799f81eb39e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:33.989749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78087f77-a318-4896-80fe-799f81eb39e6 admin admin] PATH_INFO: `/v3/projects/565a36d9284a4a8e8eea0bbf0a1a0111/users/0c4934cbef324f618f6c59b9af30a02b/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.014626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78087f77-a318-4896-80fe-799f81eb39e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565a36d9284a4a8e8eea0bbf0a1a0111, user_id=0c4934cbef324f618f6c59b9af30a02b, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:34.021344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a40f44-5a4b-4f9c-b91d-4bf7c1b8991b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:34.043662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78087f77-a318-4896-80fe-799f81eb39e6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:34.405142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 779/1550] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:33 2022] POST /identity/v3/users => generated 297 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:34.406397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a40f44-5a4b-4f9c-b91d-4bf7c1b8991b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:34.417240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a40f44-5a4b-4f9c-b91d-4bf7c1b8991b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:34.421993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76485b16-7715-4fbd-8401-d8882bfd0aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:34.422599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76485b16-7715-4fbd-8401-d8882bfd0aae admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:34.422919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76485b16-7715-4fbd-8401-d8882bfd0aae admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:34.423249 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76485b16-7715-4fbd-8401-d8882bfd0aae admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.424165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76485b16-7715-4fbd-8401-d8882bfd0aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:34.437056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 772/1551] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:33 2022] PUT /identity/v3/projects/565a36d9284a4a8e8eea0bbf0a1a0111/users/0c4934cbef324f618f6c59b9af30a02b/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:34.448035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78087f77-a318-4896-80fe-799f81eb39e6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:34.451040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76485b16-7715-4fbd-8401-d8882bfd0aae admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:34.464713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 780/1552] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:34.469164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76485b16-7715-4fbd-8401-d8882bfd0aae admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:34.481488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76485b16-7715-4fbd-8401-d8882bfd0aae admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:34.551207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78087f77-a318-4896-80fe-799f81eb39e6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:34.556234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb7250-4de6-43bd-9388-7dda2875f934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:34.556918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb7250-4de6-43bd-9388-7dda2875f934 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:34.557155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9eebf-e86c-4cc0-9570-85a8b0b9d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:34.557345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb7250-4de6-43bd-9388-7dda2875f934 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:34.557507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb7250-4de6-43bd-9388-7dda2875f934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.557800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9eebf-e86c-4cc0-9570-85a8b0b9d598 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:34.558099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9eebf-e86c-4cc0-9570-85a8b0b9d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:34.558414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9eebf-e86c-4cc0-9570-85a8b0b9d598 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.559120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9eebf-e86c-4cc0-9570-85a8b0b9d598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:34.569977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb7250-4de6-43bd-9388-7dda2875f934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:34.585799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9eebf-e86c-4cc0-9570-85a8b0b9d598 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:34.596594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb7250-4de6-43bd-9388-7dda2875f934 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:34.597092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 781/1553] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:34.597946 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9eebf-e86c-4cc0-9570-85a8b0b9d598 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:34.610393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 773/1554] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:34.611266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb7250-4de6-43bd-9388-7dda2875f934 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:34.612922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9eebf-e86c-4cc0-9570-85a8b0b9d598 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:34.619526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d60fa-3aac-44c3-b523-cf36d5c8fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:34.620166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d60fa-3aac-44c3-b523-cf36d5c8fc87 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:34.620487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d60fa-3aac-44c3-b523-cf36d5c8fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:34.620894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d60fa-3aac-44c3-b523-cf36d5c8fc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.621726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d60fa-3aac-44c3-b523-cf36d5c8fc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:34.623526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb7250-4de6-43bd-9388-7dda2875f934 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:34.631044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403c78a-db6b-46ed-a054-5b45a5770ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:34.631995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403c78a-db6b-46ed-a054-5b45a5770ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:34.632357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403c78a-db6b-46ed-a054-5b45a5770ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:34.633200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403c78a-db6b-46ed-a054-5b45a5770ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.633989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403c78a-db6b-46ed-a054-5b45a5770ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:34.649083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d60fa-3aac-44c3-b523-cf36d5c8fc87 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:34.661325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 782/1555] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:34.663119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005816-4a75-4e25-9e3f-38fe983197d6 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:34.663398 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005816-4a75-4e25-9e3f-38fe983197d6 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:34.671571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005816-4a75-4e25-9e3f-38fe983197d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.676565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403c78a-db6b-46ed-a054-5b45a5770ce8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:34.691454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-ec005816-4a75-4e25-9e3f-38fe983197d6 None None] MFA Rules not processed for user `394a96c082ed47bbbd645b489a4ed208`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:34.693222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ec005816-4a75-4e25-9e3f-38fe983197d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:34.693933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 774/1556] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:34.695197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403c78a-db6b-46ed-a054-5b45a5770ce8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:34.707903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403c78a-db6b-46ed-a054-5b45a5770ce8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:34.713417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2cb0c-c8d8-49c3-91ad-5b48efdf9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:34.720264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2cb0c-c8d8-49c3-91ad-5b48efdf9976 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:34.720264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2cb0c-c8d8-49c3-91ad-5b48efdf9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:34.720264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2cb0c-c8d8-49c3-91ad-5b48efdf9976 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.720264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2cb0c-c8d8-49c3-91ad-5b48efdf9976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:34.745545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2cb0c-c8d8-49c3-91ad-5b48efdf9976 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:34.757524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 775/1557] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:34.758327 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2cb0c-c8d8-49c3-91ad-5b48efdf9976 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:34.770357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2cb0c-c8d8-49c3-91ad-5b48efdf9976 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:34.775563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a36c9e-51a7-4b70-acb5-26fe975518bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:34.776467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36c9e-51a7-4b70-acb5-26fe975518bb admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:34.776873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36c9e-51a7-4b70-acb5-26fe975518bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:34.777320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a36c9e-51a7-4b70-acb5-26fe975518bb admin admin] PATH_INFO: `/v3/projects/68b28824eec64ec5aaa6b2c018208c8e/users/3d2197ff17dd4ed0a7b90d40b09829f0/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.784997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 783/1558] 10.222.0.87 () {58 vars in 1056 bytes} [Tue Jan 18 13:09:34 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:34.786411 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94fbf4-1eac-43ac-a7cd-25f6627997d0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:34.786715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94fbf4-1eac-43ac-a7cd-25f6627997d0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:34.792100 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94fbf4-1eac-43ac-a7cd-25f6627997d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:34.811283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a36c9e-51a7-4b70-acb5-26fe975518bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b28824eec64ec5aaa6b2c018208c8e, user_id=3d2197ff17dd4ed0a7b90d40b09829f0, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:34.842696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a36c9e-51a7-4b70-acb5-26fe975518bb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:34.852936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1e94fbf4-1eac-43ac-a7cd-25f6627997d0 None None] MFA Rules not processed for user `0c4934cbef324f618f6c59b9af30a02b`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:34.854150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1e94fbf4-1eac-43ac-a7cd-25f6627997d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:34.940258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 784/1559] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:34 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:34.941056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94fbf4-1eac-43ac-a7cd-25f6627997d0 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:34.954283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94fbf4-1eac-43ac-a7cd-25f6627997d0 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:34.962874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 776/1560] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:34 2022] PUT /identity/v3/projects/68b28824eec64ec5aaa6b2c018208c8e/users/3d2197ff17dd4ed0a7b90d40b09829f0/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:34.964284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a36c9e-51a7-4b70-acb5-26fe975518bb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:35.028430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1f70a-e989-4ac8-8254-bdcf6146450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:35.029825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1f70a-e989-4ac8-8254-bdcf6146450a admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.030158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1f70a-e989-4ac8-8254-bdcf6146450a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.030512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1f70a-e989-4ac8-8254-bdcf6146450a admin admin] PATH_INFO: `/v3/projects/485d07b093714f799748f7230f4f424c/users/8b1a721f59ff42fdaa7e346017c72a96/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.052551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1f70a-e989-4ac8-8254-bdcf6146450a admin admin] RBAC: Authorizing `identity:create_grant(project_id=485d07b093714f799748f7230f4f424c, user_id=8b1a721f59ff42fdaa7e346017c72a96, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:35.063235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a36c9e-51a7-4b70-acb5-26fe975518bb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:35.072701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80eff4-ea55-490f-852f-f8696d26201b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:35.075276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80eff4-ea55-490f-852f-f8696d26201b admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.075276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80eff4-ea55-490f-852f-f8696d26201b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.075276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80eff4-ea55-490f-852f-f8696d26201b admin admin] PATH_INFO: `/v3/projects/01f8cf4a99844ed198a8c53bf4717dd3/users/11a32d2e30a94d1990bbd9a2b0447588/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.081129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1f70a-e989-4ac8-8254-bdcf6146450a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:35.117368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80eff4-ea55-490f-852f-f8696d26201b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f8cf4a99844ed198a8c53bf4717dd3, user_id=11a32d2e30a94d1990bbd9a2b0447588, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:35.149889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 785/1561] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:34 2022] PUT /identity/v3/projects/485d07b093714f799748f7230f4f424c/users/8b1a721f59ff42fdaa7e346017c72a96/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:35.163677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1f70a-e989-4ac8-8254-bdcf6146450a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:35.180235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80eff4-ea55-490f-852f-f8696d26201b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:35.265248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1f70a-e989-4ac8-8254-bdcf6146450a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:35.271005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8ed4e-dd7d-4880-827e-ef8400d4be58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:35.272936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ed4e-dd7d-4880-827e-ef8400d4be58 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.273235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ed4e-dd7d-4880-827e-ef8400d4be58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.273532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ed4e-dd7d-4880-827e-ef8400d4be58 admin admin] PATH_INFO: `/v3/projects/fc2e74ac67b84fd5bd577cc130119449/users/9dbcf5bc8a794a6cb12844dafc3bc9e1/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.288058 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 777/1562] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:34 2022] PUT /identity/v3/projects/01f8cf4a99844ed198a8c53bf4717dd3/users/11a32d2e30a94d1990bbd9a2b0447588/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:35.289583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80eff4-ea55-490f-852f-f8696d26201b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:35.300623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8ed4e-dd7d-4880-827e-ef8400d4be58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2e74ac67b84fd5bd577cc130119449, user_id=9dbcf5bc8a794a6cb12844dafc3bc9e1, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:35.332946 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8ed4e-dd7d-4880-827e-ef8400d4be58 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:35.379680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80eff4-ea55-490f-852f-f8696d26201b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:35.384726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3836458-103f-47fd-ba07-f822dc2ab006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:35.385562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3836458-103f-47fd-ba07-f822dc2ab006 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.385853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3836458-103f-47fd-ba07-f822dc2ab006 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.386136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3836458-103f-47fd-ba07-f822dc2ab006 admin admin] PATH_INFO: `/v3/projects/f8a6ebddf5974a7cb6da6cb755f28e87/users/28f976b0f7eb49008f26df866244e9d7/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.411689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3836458-103f-47fd-ba07-f822dc2ab006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a6ebddf5974a7cb6da6cb755f28e87, user_id=28f976b0f7eb49008f26df866244e9d7, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:35.418580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 786/1563] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:35 2022] PUT /identity/v3/projects/fc2e74ac67b84fd5bd577cc130119449/users/9dbcf5bc8a794a6cb12844dafc3bc9e1/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:35.420371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8ed4e-dd7d-4880-827e-ef8400d4be58 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:35.440048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3836458-103f-47fd-ba07-f822dc2ab006 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:35.525741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8ed4e-dd7d-4880-827e-ef8400d4be58 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:35.535969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d87d4-a572-4d00-9a75-171651c7d978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:35.538980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 778/1564] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:35 2022] PUT /identity/v3/projects/f8a6ebddf5974a7cb6da6cb755f28e87/users/28f976b0f7eb49008f26df866244e9d7/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:35.539134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d87d4-a572-4d00-9a75-171651c7d978 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.539134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d87d4-a572-4d00-9a75-171651c7d978 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.539564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d87d4-a572-4d00-9a75-171651c7d978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.539685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3836458-103f-47fd-ba07-f822dc2ab006 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:35.622579 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d87d4-a572-4d00-9a75-171651c7d978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:35.624962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3836458-103f-47fd-ba07-f822dc2ab006 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:35.632833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dd826-bf80-45ff-84e5-b517470f8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:35.633449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dd826-bf80-45ff-84e5-b517470f8e2b admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.633730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dd826-bf80-45ff-84e5-b517470f8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.634007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dd826-bf80-45ff-84e5-b517470f8e2b admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.634659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dd826-bf80-45ff-84e5-b517470f8e2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:35.648528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d87d4-a572-4d00-9a75-171651c7d978 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:35.659648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 787/1565] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:35 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:35.661529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c487b9-0c00-4dc7-802e-6a8d2e2ade63 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.662361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c487b9-0c00-4dc7-802e-6a8d2e2ade63 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.662644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c487b9-0c00-4dc7-802e-6a8d2e2ade63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.662821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1dd826-bf80-45ff-84e5-b517470f8e2b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:35.776864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b0c487b9-0c00-4dc7-802e-6a8d2e2ade63 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:35.779613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b0c487b9-0c00-4dc7-802e-6a8d2e2ade63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:35.786547 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 779/1566] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:35 2022] POST /identity/v3/projects => generated 371 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:35.789708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124172d6-74ac-43a8-8f7b-2154993d0909 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.790657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 788/1567] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:35.791028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124172d6-74ac-43a8-8f7b-2154993d0909 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.791597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124172d6-74ac-43a8-8f7b-2154993d0909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.791994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0e83b-c441-41fd-8a76-0617c394fecb None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.792326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0e83b-c441-41fd-8a76-0617c394fecb None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.792585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0e83b-c441-41fd-8a76-0617c394fecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.845387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d3c0e83b-c441-41fd-8a76-0617c394fecb None None] MFA Rules not processed for user `11a32d2e30a94d1990bbd9a2b0447588`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:35.845387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d3c0e83b-c441-41fd-8a76-0617c394fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:35.858678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-124172d6-74ac-43a8-8f7b-2154993d0909 None None] MFA Rules not processed for user `8b1a721f59ff42fdaa7e346017c72a96`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:35.860497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-124172d6-74ac-43a8-8f7b-2154993d0909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:35.943799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 789/1568] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:35.945288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e7657-cdb9-4db6-9eb1-6e0a50dd8d32 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:35.945660 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e7657-cdb9-4db6-9eb1-6e0a50dd8d32 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:35.946004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e7657-cdb9-4db6-9eb1-6e0a50dd8d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:35.973435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d41e7657-cdb9-4db6-9eb1-6e0a50dd8d32 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:35.974945 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d41e7657-cdb9-4db6-9eb1-6e0a50dd8d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:36.006470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 780/1569] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:36.007896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115da6-d8c7-4d71-aaad-9f6f94af20fc None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.008195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115da6-d8c7-4d71-aaad-9f6f94af20fc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.008489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115da6-d8c7-4d71-aaad-9f6f94af20fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.058674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-04115da6-d8c7-4d71-aaad-9f6f94af20fc None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:36.059821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-04115da6-d8c7-4d71-aaad-9f6f94af20fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:36.085236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 790/1570] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:36.088739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e7657-cdb9-4db6-9eb1-6e0a50dd8d32 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:36.105408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e7657-cdb9-4db6-9eb1-6e0a50dd8d32 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:36.112949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f0262-504b-414a-a64b-0bb714ac47d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:36.120070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0262-504b-414a-a64b-0bb714ac47d4 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.120070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0262-504b-414a-a64b-0bb714ac47d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.120070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f0262-504b-414a-a64b-0bb714ac47d4 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.120070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f0262-504b-414a-a64b-0bb714ac47d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:36.154091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f0262-504b-414a-a64b-0bb714ac47d4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:36.205280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 781/1571] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:36.205280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115da6-d8c7-4d71-aaad-9f6f94af20fc None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:36.279733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115da6-d8c7-4d71-aaad-9f6f94af20fc None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:36.283562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11226-1f80-443f-ac05-14792b2bafaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:36.284159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11226-1f80-443f-ac05-14792b2bafaa service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.284459 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11226-1f80-443f-ac05-14792b2bafaa service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.284724 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11226-1f80-443f-ac05-14792b2bafaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.294944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c11226-1f80-443f-ac05-14792b2bafaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:36.310128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 791/1572] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:36 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:36.313995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5695f55-ee71-46c3-b26f-3d62d4a1d03f None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.314385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5695f55-ee71-46c3-b26f-3d62d4a1d03f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.314738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5695f55-ee71-46c3-b26f-3d62d4a1d03f None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.316646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 792/1573] 10.222.0.87 () {54 vars in 959 bytes} [Tue Jan 18 13:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:09:36.317384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5695f55-ee71-46c3-b26f-3d62d4a1d03f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:36.329918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c11226-1f80-443f-ac05-14792b2bafaa service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:36.341283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 782/1574] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:36.342275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11226-1f80-443f-ac05-14792b2bafaa service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:36.393716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5695f55-ee71-46c3-b26f-3d62d4a1d03f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:36.397764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a1d65-7f3c-4e58-8842-8661d2df58b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:36.398380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a1d65-7f3c-4e58-8842-8661d2df58b7 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.398651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a1d65-7f3c-4e58-8842-8661d2df58b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.398934 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a1d65-7f3c-4e58-8842-8661d2df58b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.412257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11226-1f80-443f-ac05-14792b2bafaa service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:36.415963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f67fc4-da5f-49cf-a6a3-932875892eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:36.419137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a1d65-7f3c-4e58-8842-8661d2df58b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:36.419662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f67fc4-da5f-49cf-a6a3-932875892eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.419662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f67fc4-da5f-49cf-a6a3-932875892eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.419662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f67fc4-da5f-49cf-a6a3-932875892eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.444150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a1d65-7f3c-4e58-8842-8661d2df58b7 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:36.453631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 793/1575] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:36 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:36.454460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a1d65-7f3c-4e58-8842-8661d2df58b7 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:36.480847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a1d65-7f3c-4e58-8842-8661d2df58b7 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:36.487644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d895a-3dce-428c-b7c7-95fa8d997e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:36.488231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d895a-3dce-428c-b7c7-95fa8d997e32 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.488514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d895a-3dce-428c-b7c7-95fa8d997e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.488797 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d895a-3dce-428c-b7c7-95fa8d997e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.502206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f67fc4-da5f-49cf-a6a3-932875892eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:36.519182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d895a-3dce-428c-b7c7-95fa8d997e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:36.529107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f67fc4-da5f-49cf-a6a3-932875892eb1 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:36.542231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 783/1576] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:36 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:36.543351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f67fc4-da5f-49cf-a6a3-932875892eb1 service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:36.554649 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f67fc4-da5f-49cf-a6a3-932875892eb1 service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:36.559794 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1ad8c-3c76-47c6-8495-f2adb143e69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:36.560637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1ad8c-3c76-47c6-8495-f2adb143e69e service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.560970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1ad8c-3c76-47c6-8495-f2adb143e69e service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.561413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1ad8c-3c76-47c6-8495-f2adb143e69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.574207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1ad8c-3c76-47c6-8495-f2adb143e69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:36.582048 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d895a-3dce-428c-b7c7-95fa8d997e32 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:36.604208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1ad8c-3c76-47c6-8495-f2adb143e69e service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:36.620737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 784/1577] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:36.620737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1ad8c-3c76-47c6-8495-f2adb143e69e service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:36.620940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 794/1578] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:36.620940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc75a-45ce-410b-8b43-16963dfd7d68 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.620940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc75a-45ce-410b-8b43-16963dfd7d68 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.620940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fc75a-45ce-410b-8b43-16963dfd7d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.642188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1ad8c-3c76-47c6-8495-f2adb143e69e service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:36.667912 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c4fbe-b1de-4c67-ad18-071af30379c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:36.668661 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4fbe-b1de-4c67-ad18-071af30379c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.669078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4fbe-b1de-4c67-ad18-071af30379c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.669467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4fbe-b1de-4c67-ad18-071af30379c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.670483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c4fbe-b1de-4c67-ad18-071af30379c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:36.674109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f35fc75a-45ce-410b-8b43-16963dfd7d68 None None] MFA Rules not processed for user `394a96c082ed47bbbd645b489a4ed208`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:36.675651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f35fc75a-45ce-410b-8b43-16963dfd7d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:36.712347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 795/1579] 10.222.0.87 () {58 vars in 1056 bytes} [Tue Jan 18 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:36.717633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5a00e-fa27-4d8a-80c1-c520a5101975 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.718146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5a00e-fa27-4d8a-80c1-c520a5101975 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.719815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5a00e-fa27-4d8a-80c1-c520a5101975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.736805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c4fbe-b1de-4c67-ad18-071af30379c5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:36.767050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 785/1580] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:36.774442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c4fbe-b1de-4c67-ad18-071af30379c5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:36.800226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c4fbe-b1de-4c67-ad18-071af30379c5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:36.816135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d578ca-2c5a-4d48-8104-e4e2658fba58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:36.816868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d578ca-2c5a-4d48-8104-e4e2658fba58 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.817256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d578ca-2c5a-4d48-8104-e4e2658fba58 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.817700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d578ca-2c5a-4d48-8104-e4e2658fba58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.831760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e5f5a00e-fa27-4d8a-80c1-c520a5101975 None None] MFA Rules not processed for user `33eabb14bdfd4a70b52101bd2333dc48`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:36.834610 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e5f5a00e-fa27-4d8a-80c1-c520a5101975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:36.835554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d578ca-2c5a-4d48-8104-e4e2658fba58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:36.874861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d578ca-2c5a-4d48-8104-e4e2658fba58 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:36.892557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 786/1581] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:36 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:36.892834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d578ca-2c5a-4d48-8104-e4e2658fba58 service nova] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:36.914009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d578ca-2c5a-4d48-8104-e4e2658fba58 service nova] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:36.924087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c261a-1648-42a7-b352-84ad5896ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:36.925020 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c261a-1648-42a7-b352-84ad5896ea1b admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.925316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c261a-1648-42a7-b352-84ad5896ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.925661 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c261a-1648-42a7-b352-84ad5896ea1b admin admin] PATH_INFO: `/v3/projects/71f21770f652420f98cb8eed13d2db92/users/fb6a3b4d320a42acae8883adedbcd015/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:36.952409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c261a-1648-42a7-b352-84ad5896ea1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f21770f652420f98cb8eed13d2db92, user_id=fb6a3b4d320a42acae8883adedbcd015, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:36.969727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 796/1582] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:36.983549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c261a-1648-42a7-b352-84ad5896ea1b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:36.983997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e2876-05ac-4f4e-997a-df33dd55ccba None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:36.984483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e2876-05ac-4f4e-997a-df33dd55ccba None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:36.984943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e2876-05ac-4f4e-997a-df33dd55ccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:37.029467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5f9e2876-05ac-4f4e-997a-df33dd55ccba None None] MFA Rules not processed for user `33eabb14bdfd4a70b52101bd2333dc48`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:37.031981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5f9e2876-05ac-4f4e-997a-df33dd55ccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:37.046630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 797/1583] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:36 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:37.119447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 787/1584] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:36 2022] PUT /identity/v3/projects/71f21770f652420f98cb8eed13d2db92/users/fb6a3b4d320a42acae8883adedbcd015/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:37.124449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e2876-05ac-4f4e-997a-df33dd55ccba None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:37.143555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e2876-05ac-4f4e-997a-df33dd55ccba None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:37.246622 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898d107-7abe-4995-8cb5-85fd28166f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:37.247200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898d107-7abe-4995-8cb5-85fd28166f1b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:37.247658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898d107-7abe-4995-8cb5-85fd28166f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:37.247995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898d107-7abe-4995-8cb5-85fd28166f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:37.248760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898d107-7abe-4995-8cb5-85fd28166f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:37.277278 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898d107-7abe-4995-8cb5-85fd28166f1b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:37.292626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 798/1585] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:37.294951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c261a-1648-42a7-b352-84ad5896ea1b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:37.310165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c261a-1648-42a7-b352-84ad5896ea1b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:37.316013 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ebcd9-6493-42db-94a6-6cfd7ef5e9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:37.317012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ebcd9-6493-42db-94a6-6cfd7ef5e9ac admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:37.317313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ebcd9-6493-42db-94a6-6cfd7ef5e9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:37.317658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ebcd9-6493-42db-94a6-6cfd7ef5e9ac admin admin] PATH_INFO: `/v3/projects/71f21770f652420f98cb8eed13d2db92/users/fb6a3b4d320a42acae8883adedbcd015/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:37.321675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ebcd9-6493-42db-94a6-6cfd7ef5e9ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f21770f652420f98cb8eed13d2db92, user_id=fb6a3b4d320a42acae8883adedbcd015, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:37.329607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898d107-7abe-4995-8cb5-85fd28166f1b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:37.358260 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ebcd9-6493-42db-94a6-6cfd7ef5e9ac admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:37.367886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 788/1586] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:37 2022] PUT /identity/v3/projects/71f21770f652420f98cb8eed13d2db92/users/fb6a3b4d320a42acae8883adedbcd015/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:09:37.371580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ebcd9-6493-42db-94a6-6cfd7ef5e9ac admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:37.449864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898d107-7abe-4995-8cb5-85fd28166f1b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:37.495359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ebcd9-6493-42db-94a6-6cfd7ef5e9ac admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:37.499410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f8231-59fd-4b64-b482-cb91a27c1656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:37.500059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f8231-59fd-4b64-b482-cb91a27c1656 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:37.500415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f8231-59fd-4b64-b482-cb91a27c1656 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:37.500600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f8231-59fd-4b64-b482-cb91a27c1656 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:37.501330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f8231-59fd-4b64-b482-cb91a27c1656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:37.529596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f8231-59fd-4b64-b482-cb91a27c1656 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:37.541803 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 789/1587] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:09:37.546529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f8231-59fd-4b64-b482-cb91a27c1656 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:37.560516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f8231-59fd-4b64-b482-cb91a27c1656 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:37.566061 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa4911-72fa-4892-8135-e78640ebc699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:37.566981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa4911-72fa-4892-8135-e78640ebc699 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:37.567277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa4911-72fa-4892-8135-e78640ebc699 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:37.570018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa4911-72fa-4892-8135-e78640ebc699 admin admin] PATH_INFO: `/v3/projects/71f21770f652420f98cb8eed13d2db92/users/fb6a3b4d320a42acae8883adedbcd015/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:37.570293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d962ce7-311b-4069-83dd-4deed6a45219 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:37.570856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa4911-72fa-4892-8135-e78640ebc699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f21770f652420f98cb8eed13d2db92, user_id=fb6a3b4d320a42acae8883adedbcd015, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:37.571189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d962ce7-311b-4069-83dd-4deed6a45219 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:37.571882 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d962ce7-311b-4069-83dd-4deed6a45219 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:37.572204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d962ce7-311b-4069-83dd-4deed6a45219 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:37.603603 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa4911-72fa-4892-8135-e78640ebc699 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:37.673548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d962ce7-311b-4069-83dd-4deed6a45219 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:37.701575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d962ce7-311b-4069-83dd-4deed6a45219 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:37.712385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 799/1588] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:09:37.801354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d962ce7-311b-4069-83dd-4deed6a45219 service nova] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:37.803629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5d962ce7-311b-4069-83dd-4deed6a45219 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:37.825103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 790/1589] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:37 2022] PUT /identity/v3/projects/71f21770f652420f98cb8eed13d2db92/users/fb6a3b4d320a42acae8883adedbcd015/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:09:37.837114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72853-6f3b-48e6-a486-1d644dce62f8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:37.837647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72853-6f3b-48e6-a486-1d644dce62f8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:37.838222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d72853-6f3b-48e6-a486-1d644dce62f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:37.910407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-79d72853-6f3b-48e6-a486-1d644dce62f8 None None] MFA Rules not processed for user `fb6a3b4d320a42acae8883adedbcd015`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:37.912759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-79d72853-6f3b-48e6-a486-1d644dce62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:37.952830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d962ce7-311b-4069-83dd-4deed6a45219 service nova] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:38.090629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 791/1590] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:37 2022] POST /identity/v3/auth/tokens => generated 3745 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:38.096932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6b670-8f51-4579-8833-77e98002a900 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aecbdda2f524fbca580d99b3001bed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:38.097700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b670-8f51-4579-8833-77e98002a900 service glance] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:38.098139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b670-8f51-4579-8833-77e98002a900 service glance] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:38.098539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b670-8f51-4579-8833-77e98002a900 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:38.139643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d72853-6f3b-48e6-a486-1d644dce62f8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:38.244999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d72853-6f3b-48e6-a486-1d644dce62f8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:38.253142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1839-1597-45ee-a3da-68621264d4ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:38.253895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1839-1597-45ee-a3da-68621264d4ba service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:38.254425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1839-1597-45ee-a3da-68621264d4ba service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:38.254997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1839-1597-45ee-a3da-68621264d4ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:38.276096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1839-1597-45ee-a3da-68621264d4ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:38.281530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6b670-8f51-4579-8833-77e98002a900 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:38.311406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6b670-8f51-4579-8833-77e98002a900 service glance] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:38.315217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1839-1597-45ee-a3da-68621264d4ba service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:38.329220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 792/1591] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:38 2022] GET /identity/v3/auth/tokens => generated 3745 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:38.334643 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 800/1592] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:37 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:09:38.747723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1839-1597-45ee-a3da-68621264d4ba service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:38.770981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6b670-8f51-4579-8833-77e98002a900 service glance] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:38.788854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6b670-8f51-4579-8833-77e98002a900 service glance] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:38.792550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c8e2-a424-434b-9506-61bd33d206ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:38.793150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c8e2-a424-434b-9506-61bd33d206ba service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:38.793443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c8e2-a424-434b-9506-61bd33d206ba service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:38.793729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c8e2-a424-434b-9506-61bd33d206ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:38.879705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1839-1597-45ee-a3da-68621264d4ba service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:38.891520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:38.892344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:38.892817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:38.893115 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] PATH_INFO: `/v3/users/11a32d2e30a94d1990bbd9a2b0447588` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:38.896842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a32d2e30a94d1990bbd9a2b0447588)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:38.898525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9c8e2-a424-434b-9506-61bd33d206ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:38.929206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9c8e2-a424-434b-9506-61bd33d206ba service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:38.946147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 801/1593] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:38 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:38.956389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: WARNING py.warnings [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 13:09:38.956389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: warnings.warn(msg) Jan 18 13:09:38.956389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: Jan 18 13:09:38.963374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:39.291900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c515d-7759-4199-bfc6-66efdca340a6 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:39.292201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c515d-7759-4199-bfc6-66efdca340a6 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:39.292513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c515d-7759-4199-bfc6-66efdca340a6 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:39.294191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 802/1594] 10.222.0.87 () {54 vars in 912 bytes} [Tue Jan 18 13:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:09:39.309044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5a58c-f630-40f4-b8ff-0d9f647f66f4 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:39.310087 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5a58c-f630-40f4-b8ff-0d9f647f66f4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:39.311002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5a58c-f630-40f4-b8ff-0d9f647f66f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:39.316134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a32d2e30a94d1990bbd9a2b0447588'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:39.370236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a32d2e30a94d1990bbd9a2b0447588'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:39.372303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a32d2e30a94d1990bbd9a2b0447588'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:39.391199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a32d2e30a94d1990bbd9a2b0447588'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:39.408437 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5de5a58c-f630-40f4-b8ff-0d9f647f66f4 None None] MFA Rules not processed for user `cb93a689fc8b4aaab37c8fa4f9a08d64`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:39.409932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5de5a58c-f630-40f4-b8ff-0d9f647f66f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:39.472547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 803/1595] 10.222.0.87 () {58 vars in 1009 bytes} [Tue Jan 18 13:09:39 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:39.484435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5a58c-f630-40f4-b8ff-0d9f647f66f4 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:39.493772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5a58c-f630-40f4-b8ff-0d9f647f66f4 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:39.497321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553986d5-204f-416c-b88a-23306b88e290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:39.497899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553986d5-204f-416c-b88a-23306b88e290 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:39.498186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553986d5-204f-416c-b88a-23306b88e290 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:39.498468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553986d5-204f-416c-b88a-23306b88e290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:39.506698 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553986d5-204f-416c-b88a-23306b88e290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:39.533469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553986d5-204f-416c-b88a-23306b88e290 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:39.543992 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 804/1596] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:39 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:09:39.563390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a32d2e30a94d1990bbd9a2b0447588'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:39.576529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 793/1597] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:09:38 2022] DELETE /identity/v3/users/11a32d2e30a94d1990bbd9a2b0447588 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:39.577860 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b9be6-caf9-408c-8d04-f64acbeca078 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:39.578160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b9be6-caf9-408c-8d04-f64acbeca078 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:39.578446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b9be6-caf9-408c-8d04-f64acbeca078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:39.603806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b73b9be6-caf9-408c-8d04-f64acbeca078 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:39.605530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b73b9be6-caf9-408c-8d04-f64acbeca078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:39.703671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 805/1598] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:39.738727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:39.740850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:39.829241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe666e-0a38-4914-96ff-fbff5263d8f8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:39.833208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba349584-103e-48ac-85ef-6e77f9717d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:39.834098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba349584-103e-48ac-85ef-6e77f9717d8a service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:39.834487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba349584-103e-48ac-85ef-6e77f9717d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:39.834869 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba349584-103e-48ac-85ef-6e77f9717d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:39.846408 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba349584-103e-48ac-85ef-6e77f9717d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:39.875509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba349584-103e-48ac-85ef-6e77f9717d8a service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:39.886897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 794/1599] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:40.576628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad6ef9-8651-4cf9-8306-8891c45e8ba0 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:40.577116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad6ef9-8651-4cf9-8306-8891c45e8ba0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:40.577565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad6ef9-8651-4cf9-8306-8891c45e8ba0 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:40.585222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 806/1600] 10.222.0.87 () {54 vars in 960 bytes} [Tue Jan 18 13:09:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:09:40.588929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c786a78-be46-4e66-a8a2-5f04af8857d1 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:40.589358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c786a78-be46-4e66-a8a2-5f04af8857d1 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:40.589767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c786a78-be46-4e66-a8a2-5f04af8857d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:40.620255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-8c786a78-be46-4e66-a8a2-5f04af8857d1 None None] MFA Rules not processed for user `0a678f789e3549a3b634acc510c5d0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:40.621595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8c786a78-be46-4e66-a8a2-5f04af8857d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:40.760151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad6ef9-8651-4cf9-8306-8891c45e8ba0 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:40.761136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 795/1601] 10.222.0.87 () {58 vars in 1057 bytes} [Tue Jan 18 13:09:40 2022] POST /identity/v3/auth/tokens => generated 3738 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:40.788662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad6ef9-8651-4cf9-8306-8891c45e8ba0 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:40.809650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:40.811137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:40.811931 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:40.812627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:40.815918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:40.855266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:40.955741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:40.969724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 807/1602] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:40 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:09:41.277169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c786a78-be46-4e66-a8a2-5f04af8857d1 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:41.280109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8c786a78-be46-4e66-a8a2-5f04af8857d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:41.319906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c786a78-be46-4e66-a8a2-5f04af8857d1 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:41.337232 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdee2e-5134-48e1-9695-e31f684b62b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:41.338215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdee2e-5134-48e1-9695-e31f684b62b4 service placement] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:41.338666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdee2e-5134-48e1-9695-e31f684b62b4 service placement] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:41.339119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdee2e-5134-48e1-9695-e31f684b62b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:41.344851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5acdee2e-5134-48e1-9695-e31f684b62b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:41.370359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdee2e-5134-48e1-9695-e31f684b62b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:41.422777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdee2e-5134-48e1-9695-e31f684b62b4 service placement] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:41.435029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 796/1603] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:41 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:41.916296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:41.918413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:41.947985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed9789-cc16-4b40-b2ee-7dcaf3ddcb12 service placement] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:41.972910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:41.974208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:41.975942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:41.976473 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] PATH_INFO: `/v3/projects/01f8cf4a99844ed198a8c53bf4717dd3` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:41.978774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f8cf4a99844ed198a8c53bf4717dd3)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:42.006895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: WARNING py.warnings [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 18 13:09:42.006895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: warnings.warn(msg) Jan 18 13:09:42.006895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: Jan 18 13:09:42.008336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:42.223529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f8cf4a99844ed198a8c53bf4717dd3', 'request_id': 'req-a434eda7-0326-4b61-8b20-18102295f7f9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:42.339909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f8cf4a99844ed198a8c53bf4717dd3', 'request_id': 'req-a434eda7-0326-4b61-8b20-18102295f7f9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:42.375125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f8cf4a99844ed198a8c53bf4717dd3', 'request_id': 'req-a434eda7-0326-4b61-8b20-18102295f7f9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:42.390612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] The token cache is being invalidate because project 01f8cf4a99844ed198a8c53bf4717dd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:09:42.391633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:42.392970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a434eda7-0326-4b61-8b20-18102295f7f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:09:42.394957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 808/1604] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:09:41 2022] DELETE /identity/v3/projects/01f8cf4a99844ed198a8c53bf4717dd3 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:42.401472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee5dd-18e3-48e6-a187-d6a42faedf26 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:42.402366 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee5dd-18e3-48e6-a187-d6a42faedf26 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:42.402840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee5dd-18e3-48e6-a187-d6a42faedf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:42.465182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-216ee5dd-18e3-48e6-a187-d6a42faedf26 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:42.467853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-216ee5dd-18e3-48e6-a187-d6a42faedf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:42.630403 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 797/1605] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:42.630813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ead6-4efe-409e-ad87-01bebe9db5a9 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:42.630813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ead6-4efe-409e-ad87-01bebe9db5a9 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:42.630813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8ead6-4efe-409e-ad87-01bebe9db5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:42.653386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-dde8ead6-4efe-409e-ad87-01bebe9db5a9 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:42.654764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-dde8ead6-4efe-409e-ad87-01bebe9db5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:42.681022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 809/1606] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:42.688848 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee5dd-18e3-48e6-a187-d6a42faedf26 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:42.702590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee5dd-18e3-48e6-a187-d6a42faedf26 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:42.718201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f63396-2eb9-4a29-8a61-cd9fdd26fc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:42.718887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f63396-2eb9-4a29-8a61-cd9fdd26fc42 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:42.719183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f63396-2eb9-4a29-8a61-cd9fdd26fc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:42.719497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f63396-2eb9-4a29-8a61-cd9fdd26fc42 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:42.721582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f63396-2eb9-4a29-8a61-cd9fdd26fc42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:09:42.721895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f63396-2eb9-4a29-8a61-cd9fdd26fc42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:42.748989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f63396-2eb9-4a29-8a61-cd9fdd26fc42 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:42.774194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 798/1607] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:09:42.779153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8ead6-4efe-409e-ad87-01bebe9db5a9 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:42.791122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8ead6-4efe-409e-ad87-01bebe9db5a9 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:42.796725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526a05-971a-46e3-8dde-2a1b6df27ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:42.797873 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526a05-971a-46e3-8dde-2a1b6df27ffd admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:42.798392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526a05-971a-46e3-8dde-2a1b6df27ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:42.798859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526a05-971a-46e3-8dde-2a1b6df27ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:42.799917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a526a05-971a-46e3-8dde-2a1b6df27ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:42.853140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a526a05-971a-46e3-8dde-2a1b6df27ffd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:43.078243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 810/1608] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:42 2022] POST /identity/v3/projects => generated 357 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:43.079610 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f63396-2eb9-4a29-8a61-cd9fdd26fc42 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:43.109522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f63396-2eb9-4a29-8a61-cd9fdd26fc42 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:43.357380 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63907d73-62ab-48a1-9021-80ffa57c8030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:43.358257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63907d73-62ab-48a1-9021-80ffa57c8030 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:43.362093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63907d73-62ab-48a1-9021-80ffa57c8030 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:43.363761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63907d73-62ab-48a1-9021-80ffa57c8030 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:43.367076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63907d73-62ab-48a1-9021-80ffa57c8030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:43.429938 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63907d73-62ab-48a1-9021-80ffa57c8030 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:43.612021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 799/1609] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:43 2022] POST /identity/v3/users => generated 279 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:43.616232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526a05-971a-46e3-8dde-2a1b6df27ffd admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:43.629252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526a05-971a-46e3-8dde-2a1b6df27ffd admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:43.635736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60100102-2a61-471d-8607-5e3d2bba74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:43.636443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60100102-2a61-471d-8607-5e3d2bba74e0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:43.636806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60100102-2a61-471d-8607-5e3d2bba74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:43.637161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60100102-2a61-471d-8607-5e3d2bba74e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:43.638038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60100102-2a61-471d-8607-5e3d2bba74e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:43.674015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60100102-2a61-471d-8607-5e3d2bba74e0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:43.694713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 811/1610] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:09:43.698976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63907d73-62ab-48a1-9021-80ffa57c8030 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:43.711988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63907d73-62ab-48a1-9021-80ffa57c8030 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:43.729606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802064d-b6dc-4b3e-a4cc-b851de1543e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:43.730543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802064d-b6dc-4b3e-a4cc-b851de1543e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:43.730952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802064d-b6dc-4b3e-a4cc-b851de1543e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:43.731340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802064d-b6dc-4b3e-a4cc-b851de1543e0 admin admin] PATH_INFO: `/v3/projects/f662962148f44137ab868b4fcb2a874d/users/eae28220f96544d79d474b25aa2de55b/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:43.766336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802064d-b6dc-4b3e-a4cc-b851de1543e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f662962148f44137ab868b4fcb2a874d, user_id=eae28220f96544d79d474b25aa2de55b, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:43.795508 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802064d-b6dc-4b3e-a4cc-b851de1543e0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:43.925448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 800/1611] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:43 2022] PUT /identity/v3/projects/f662962148f44137ab868b4fcb2a874d/users/eae28220f96544d79d474b25aa2de55b/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:43.936158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42099679-24a6-4416-bf95-dac83dbab208 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:43.936728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42099679-24a6-4416-bf95-dac83dbab208 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:43.937022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42099679-24a6-4416-bf95-dac83dbab208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:43.996615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-42099679-24a6-4416-bf95-dac83dbab208 None None] MFA Rules not processed for user `eae28220f96544d79d474b25aa2de55b`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:43.997948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-42099679-24a6-4416-bf95-dac83dbab208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:44.100815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 812/1612] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:43 2022] POST /identity/v3/auth/tokens => generated 3664 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:44.107088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802064d-b6dc-4b3e-a4cc-b851de1543e0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:44.321523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802064d-b6dc-4b3e-a4cc-b851de1543e0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:44.330276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23db4-e426-4440-a014-a7e6e6fd1985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:44.331057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23db4-e426-4440-a014-a7e6e6fd1985 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:44.331480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23db4-e426-4440-a014-a7e6e6fd1985 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:44.332196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b23db4-e426-4440-a014-a7e6e6fd1985 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:44.332982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b23db4-e426-4440-a014-a7e6e6fd1985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:44.372479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b23db4-e426-4440-a014-a7e6e6fd1985 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:44.510110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 801/1613] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:09:44 2022] POST /identity/v3/projects => generated 355 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:09:44.511183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42099679-24a6-4416-bf95-dac83dbab208 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:44.534850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42099679-24a6-4416-bf95-dac83dbab208 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:44.718883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e04f6-951c-4035-b8f0-974c35a286d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:44.719434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e04f6-951c-4035-b8f0-974c35a286d8 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:44.719864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e04f6-951c-4035-b8f0-974c35a286d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:44.720151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e04f6-951c-4035-b8f0-974c35a286d8 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:44.720792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e04f6-951c-4035-b8f0-974c35a286d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:44.749344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e04f6-951c-4035-b8f0-974c35a286d8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:44.870759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 813/1614] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:09:44 2022] POST /identity/v3/users => generated 284 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:09:44.875554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23db4-e426-4440-a014-a7e6e6fd1985 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:44.889968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b23db4-e426-4440-a014-a7e6e6fd1985 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:44.902909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fa124-a06b-4e86-9853-3cfa60537543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:44.905841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fa124-a06b-4e86-9853-3cfa60537543 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:44.906320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fa124-a06b-4e86-9853-3cfa60537543 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:44.906630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fa124-a06b-4e86-9853-3cfa60537543 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:44.908908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fa124-a06b-4e86-9853-3cfa60537543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:44.989389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fa124-a06b-4e86-9853-3cfa60537543 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:45.019206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 802/1615] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:45.022261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e04f6-951c-4035-b8f0-974c35a286d8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:45.046493 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e04f6-951c-4035-b8f0-974c35a286d8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:45.051652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40533161-26ba-458f-b55a-f4442853d67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:45.052623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533161-26ba-458f-b55a-f4442853d67e admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:45.053184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533161-26ba-458f-b55a-f4442853d67e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:45.053798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40533161-26ba-458f-b55a-f4442853d67e admin admin] PATH_INFO: `/v3/projects/db8eb6021cc54c318a955c139b419e20/users/2ec3ce14e84b4a2e9b473c2f5954bdf8/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:45.076554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40533161-26ba-458f-b55a-f4442853d67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8eb6021cc54c318a955c139b419e20, user_id=2ec3ce14e84b4a2e9b473c2f5954bdf8, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:45.107207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40533161-26ba-458f-b55a-f4442853d67e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:45.189561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 814/1616] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:45 2022] PUT /identity/v3/projects/db8eb6021cc54c318a955c139b419e20/users/2ec3ce14e84b4a2e9b473c2f5954bdf8/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:45.194563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fa124-a06b-4e86-9853-3cfa60537543 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:45.213036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fa124-a06b-4e86-9853-3cfa60537543 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:45.366132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74708f00-0dfd-4a0d-a4f9-51543440198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:45.366765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74708f00-0dfd-4a0d-a4f9-51543440198a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:45.367054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74708f00-0dfd-4a0d-a4f9-51543440198a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:45.367360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74708f00-0dfd-4a0d-a4f9-51543440198a admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:45.368095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74708f00-0dfd-4a0d-a4f9-51543440198a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:45.411239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74708f00-0dfd-4a0d-a4f9-51543440198a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:45.437533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 803/1617] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:45.439479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40533161-26ba-458f-b55a-f4442853d67e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:45.453375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40533161-26ba-458f-b55a-f4442853d67e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:45.470542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6b561-344b-4d92-881c-cc2ae09caafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:45.471739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6b561-344b-4d92-881c-cc2ae09caafb admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:45.472140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6b561-344b-4d92-881c-cc2ae09caafb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:45.472653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6b561-344b-4d92-881c-cc2ae09caafb admin admin] PATH_INFO: `/v3/projects/db8eb6021cc54c318a955c139b419e20/users/2ec3ce14e84b4a2e9b473c2f5954bdf8/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:45.478846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6b561-344b-4d92-881c-cc2ae09caafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8eb6021cc54c318a955c139b419e20, user_id=2ec3ce14e84b4a2e9b473c2f5954bdf8, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:45.564765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6b561-344b-4d92-881c-cc2ae09caafb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:45.625067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 815/1618] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:45 2022] PUT /identity/v3/projects/db8eb6021cc54c318a955c139b419e20/users/2ec3ce14e84b4a2e9b473c2f5954bdf8/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:45.631006 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74708f00-0dfd-4a0d-a4f9-51543440198a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:45.668078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74708f00-0dfd-4a0d-a4f9-51543440198a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:45.809631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acd977-9e06-492b-b62e-974bc9298f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:45.810553 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acd977-9e06-492b-b62e-974bc9298f67 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:45.811190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acd977-9e06-492b-b62e-974bc9298f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:45.811809 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acd977-9e06-492b-b62e-974bc9298f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:45.813590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acd977-9e06-492b-b62e-974bc9298f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:45.854880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acd977-9e06-492b-b62e-974bc9298f67 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:45.870789 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 804/1619] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:09:45.875027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6b561-344b-4d92-881c-cc2ae09caafb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:45.891745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6b561-344b-4d92-881c-cc2ae09caafb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:45.907550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0311a91-ee7e-418d-ae3f-720d4e23326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:45.908397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0311a91-ee7e-418d-ae3f-720d4e23326d admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:45.909005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0311a91-ee7e-418d-ae3f-720d4e23326d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:45.909005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0311a91-ee7e-418d-ae3f-720d4e23326d admin admin] PATH_INFO: `/v3/projects/db8eb6021cc54c318a955c139b419e20/users/2ec3ce14e84b4a2e9b473c2f5954bdf8/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:45.911199 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0311a91-ee7e-418d-ae3f-720d4e23326d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8eb6021cc54c318a955c139b419e20, user_id=2ec3ce14e84b4a2e9b473c2f5954bdf8, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:45.956625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0311a91-ee7e-418d-ae3f-720d4e23326d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:46.070478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 816/1620] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:09:45 2022] PUT /identity/v3/projects/db8eb6021cc54c318a955c139b419e20/users/2ec3ce14e84b4a2e9b473c2f5954bdf8/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:09:46.072664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda77b3-4ee9-45b1-9958-fe8afbd7ba4b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:46.073025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda77b3-4ee9-45b1-9958-fe8afbd7ba4b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:46.073313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcda77b3-4ee9-45b1-9958-fe8afbd7ba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:46.213550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-bcda77b3-4ee9-45b1-9958-fe8afbd7ba4b None None] MFA Rules not processed for user `2ec3ce14e84b4a2e9b473c2f5954bdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:46.225183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bcda77b3-4ee9-45b1-9958-fe8afbd7ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:46.524048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 805/1621] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:46 2022] POST /identity/v3/auth/tokens => generated 3729 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:46.535432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0311a91-ee7e-418d-ae3f-720d4e23326d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:46.544052 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d0311a91-ee7e-418d-ae3f-720d4e23326d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:46.704636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0311a91-ee7e-418d-ae3f-720d4e23326d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:46.714718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bebf1b-e1fd-4566-8c8f-3429eef174d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:46.715417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bebf1b-e1fd-4566-8c8f-3429eef174d9 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:46.715814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bebf1b-e1fd-4566-8c8f-3429eef174d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:46.716480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bebf1b-e1fd-4566-8c8f-3429eef174d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:46.741389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bebf1b-e1fd-4566-8c8f-3429eef174d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:46.854910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bebf1b-e1fd-4566-8c8f-3429eef174d9 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:46.876053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 817/1622] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:46 2022] GET /identity/v3/auth/tokens => generated 3729 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:47.700982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda77b3-4ee9-45b1-9958-fe8afbd7ba4b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:47.705567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bcda77b3-4ee9-45b1-9958-fe8afbd7ba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:47.743940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcda77b3-4ee9-45b1-9958-fe8afbd7ba4b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:47.753750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d38616-c06c-470e-b779-1d6d044b1e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:47.754677 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d38616-c06c-470e-b779-1d6d044b1e93 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:47.759375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d38616-c06c-470e-b779-1d6d044b1e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:47.760442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d38616-c06c-470e-b779-1d6d044b1e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:48.017635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d38616-c06c-470e-b779-1d6d044b1e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:48.092956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d38616-c06c-470e-b779-1d6d044b1e93 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:48.126585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 806/1623] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:47 2022] GET /identity/v3/auth/tokens => generated 3664 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:49.688649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c2117-adbe-4100-a0d0-9b5bb2e70b78 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:49.690004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c2117-adbe-4100-a0d0-9b5bb2e70b78 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:49.690753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c2117-adbe-4100-a0d0-9b5bb2e70b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:49.808915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-720c2117-adbe-4100-a0d0-9b5bb2e70b78 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:49.811017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-720c2117-adbe-4100-a0d0-9b5bb2e70b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:50.030562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 818/1624] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:09:49 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:50.609073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d38616-c06c-470e-b779-1d6d044b1e93 service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:50.611916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-94d38616-c06c-470e-b779-1d6d044b1e93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:50.928414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d38616-c06c-470e-b779-1d6d044b1e93 service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:50.956487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002450d-2fcd-41f1-bda4-07e6085a8117 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:50.957386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002450d-2fcd-41f1-bda4-07e6085a8117 service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:50.957836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002450d-2fcd-41f1-bda4-07e6085a8117 service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:50.958859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002450d-2fcd-41f1-bda4-07e6085a8117 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:50.984153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002450d-2fcd-41f1-bda4-07e6085a8117 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:51.043268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002450d-2fcd-41f1-bda4-07e6085a8117 service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:51.073748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 807/1625] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:09:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 18 13:09:53.087659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc24d5-2ad4-4b97-969f-40464b7b3f01 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:53.088342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc24d5-2ad4-4b97-969f-40464b7b3f01 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:53.088342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc24d5-2ad4-4b97-969f-40464b7b3f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:53.167954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c1bc24d5-2ad4-4b97-969f-40464b7b3f01 None None] MFA Rules not processed for user `28f976b0f7eb49008f26df866244e9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:53.169710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c1bc24d5-2ad4-4b97-969f-40464b7b3f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:53.275776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 819/1626] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:53.287090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca561-b8d9-47ae-a9fd-3f94b297b738 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:53.287618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca561-b8d9-47ae-a9fd-3f94b297b738 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:53.287915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bca561-b8d9-47ae-a9fd-3f94b297b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:53.340053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-a3bca561-b8d9-47ae-a9fd-3f94b297b738 None None] MFA Rules not processed for user `28f976b0f7eb49008f26df866244e9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:53.342266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a3bca561-b8d9-47ae-a9fd-3f94b297b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:53.364936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 808/1627] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:53.375545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc24d5-2ad4-4b97-969f-40464b7b3f01 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:53.379545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c1bc24d5-2ad4-4b97-969f-40464b7b3f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:53.585676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc24d5-2ad4-4b97-969f-40464b7b3f01 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:53.591623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c257172-5934-4a32-84f4-2734dfe07981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:53.592436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c257172-5934-4a32-84f4-2734dfe07981 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:53.592822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c257172-5934-4a32-84f4-2734dfe07981 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:53.592947 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c257172-5934-4a32-84f4-2734dfe07981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:53.627627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c257172-5934-4a32-84f4-2734dfe07981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:53.693083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c257172-5934-4a32-84f4-2734dfe07981 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:53.712089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 820/1628] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:53 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:53.906630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9d3c6-fb84-434d-ab9b-be983cd1d187 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:53.907333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9d3c6-fb84-434d-ab9b-be983cd1d187 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:53.908015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9d3c6-fb84-434d-ab9b-be983cd1d187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:53.963186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-77a9d3c6-fb84-434d-ab9b-be983cd1d187 None None] MFA Rules not processed for user `9dbcf5bc8a794a6cb12844dafc3bc9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:53.964703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-77a9d3c6-fb84-434d-ab9b-be983cd1d187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:54.091154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c257172-5934-4a32-84f4-2734dfe07981 service nova] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:54.092742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5c257172-5934-4a32-84f4-2734dfe07981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:54.103691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 809/1629] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:54.142825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c257172-5934-4a32-84f4-2734dfe07981 service nova] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:54.149759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1f888-4ef4-4507-8b2f-c8040eeef490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:54.151474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1f888-4ef4-4507-8b2f-c8040eeef490 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:54.151998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1f888-4ef4-4507-8b2f-c8040eeef490 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:54.152442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1f888-4ef4-4507-8b2f-c8040eeef490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:54.174257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1f888-4ef4-4507-8b2f-c8040eeef490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:54.247336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1f888-4ef4-4507-8b2f-c8040eeef490 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:54.277618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 821/1630] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:54 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:09:55.743728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf8fc-48d6-4f4e-ba11-892783bf6e35 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:55.744500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf8fc-48d6-4f4e-ba11-892783bf6e35 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:55.744500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf8fc-48d6-4f4e-ba11-892783bf6e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:55.810118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c38bf8fc-48d6-4f4e-ba11-892783bf6e35 None None] MFA Rules not processed for user `cb93a689fc8b4aaab37c8fa4f9a08d64`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:55.812229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c38bf8fc-48d6-4f4e-ba11-892783bf6e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:55.915513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429308ea-69ec-4951-9524-10f0e194bb7d None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:55.916658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429308ea-69ec-4951-9524-10f0e194bb7d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:55.917287 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429308ea-69ec-4951-9524-10f0e194bb7d None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:55.920453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 822/1631] 10.222.0.87 () {54 vars in 912 bytes} [Tue Jan 18 13:09:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:09:55.932725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee690-25cb-44fc-a71e-2c417dc647f1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:55.933022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee690-25cb-44fc-a71e-2c417dc647f1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:55.933310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ee690-25cb-44fc-a71e-2c417dc647f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:55.973379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 810/1632] 10.222.0.91 () {58 vars in 1015 bytes} [Tue Jan 18 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:56.005729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a46ee690-25cb-44fc-a71e-2c417dc647f1 None None] MFA Rules not processed for user `cb93a689fc8b4aaab37c8fa4f9a08d64`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:56.008997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a46ee690-25cb-44fc-a71e-2c417dc647f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:56.023730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 823/1633] 10.222.0.87 () {58 vars in 1009 bytes} [Tue Jan 18 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:09:56.092604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf8fc-48d6-4f4e-ba11-892783bf6e35 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:56.094353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c38bf8fc-48d6-4f4e-ba11-892783bf6e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:56.110979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee690-25cb-44fc-a71e-2c417dc647f1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:56.121835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ee690-25cb-44fc-a71e-2c417dc647f1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:56.130997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf8fc-48d6-4f4e-ba11-892783bf6e35 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:56.139729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af96d-2fca-46c5-86c5-48dfa9448064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:56.140329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af96d-2fca-46c5-86c5-48dfa9448064 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:56.141127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e847c-df30-402d-b2ae-cb0cf41c165c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:56.141872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e847c-df30-402d-b2ae-cb0cf41c165c service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:56.144614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e847c-df30-402d-b2ae-cb0cf41c165c service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:56.144999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e847c-df30-402d-b2ae-cb0cf41c165c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:56.145514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af96d-2fca-46c5-86c5-48dfa9448064 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:56.145944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af96d-2fca-46c5-86c5-48dfa9448064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:56.167910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e847c-df30-402d-b2ae-cb0cf41c165c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:56.174824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9af96d-2fca-46c5-86c5-48dfa9448064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:56.272059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9af96d-2fca-46c5-86c5-48dfa9448064 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:56.279505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e847c-df30-402d-b2ae-cb0cf41c165c service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:56.299182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 824/1634] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:09:56.320329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 811/1635] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:09:56.502910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528f2d3-d1cb-4596-8f3a-03aa8782d1a5 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:56.503211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528f2d3-d1cb-4596-8f3a-03aa8782d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:56.503569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528f2d3-d1cb-4596-8f3a-03aa8782d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:56.636016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1528f2d3-d1cb-4596-8f3a-03aa8782d1a5 None None] MFA Rules not processed for user `3d2197ff17dd4ed0a7b90d40b09829f0`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:56.638787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1528f2d3-d1cb-4596-8f3a-03aa8782d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:56.808953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 825/1636] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:56 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:56.823033 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e847c-df30-402d-b2ae-cb0cf41c165c service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:09:56.865429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e847c-df30-402d-b2ae-cb0cf41c165c service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:09:56.881798 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a277fc-0935-47aa-9522-c4e14bb38b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:09:56.883151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a277fc-0935-47aa-9522-c4e14bb38b2a service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:56.884538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a277fc-0935-47aa-9522-c4e14bb38b2a service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:56.885172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a277fc-0935-47aa-9522-c4e14bb38b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:56.921617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a277fc-0935-47aa-9522-c4e14bb38b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:09:56.986813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a277fc-0935-47aa-9522-c4e14bb38b2a service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:09:57.015732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 812/1637] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:09:59.183968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744ee9a-e502-4f89-a052-30073ddca03a None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:59.184913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744ee9a-e502-4f89-a052-30073ddca03a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:59.185376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744ee9a-e502-4f89-a052-30073ddca03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:59.253254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-0744ee9a-e502-4f89-a052-30073ddca03a None None] MFA Rules not processed for user `28f976b0f7eb49008f26df866244e9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:59.254653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0744ee9a-e502-4f89-a052-30073ddca03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:59.314657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 826/1638] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:09:59.512729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cf9c0-5ec0-429e-aab9-8db115dc84f2 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:59.513348 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cf9c0-5ec0-429e-aab9-8db115dc84f2 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:59.513348 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3cf9c0-5ec0-429e-aab9-8db115dc84f2 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:59.515414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 813/1639] 10.222.0.87 () {54 vars in 921 bytes} [Tue Jan 18 13:09:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:09:59.533000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fc501-2ab3-4b20-9048-d60d403bfd3d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:09:59.533297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fc501-2ab3-4b20-9048-d60d403bfd3d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:09:59.533582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fc501-2ab3-4b20-9048-d60d403bfd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:09:59.614521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f37fc501-2ab3-4b20-9048-d60d403bfd3d None None] MFA Rules not processed for user `394a96c082ed47bbbd645b489a4ed208`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:09:59.616123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f37fc501-2ab3-4b20-9048-d60d403bfd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:09:59.647643 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 827/1640] 10.222.0.87 () {58 vars in 1018 bytes} [Tue Jan 18 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:00.082463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cf9c0-5ec0-429e-aab9-8db115dc84f2 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:00.084409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-df3cf9c0-5ec0-429e-aab9-8db115dc84f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:00.334814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3cf9c0-5ec0-429e-aab9-8db115dc84f2 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:00.335255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fc501-2ab3-4b20-9048-d60d403bfd3d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:00.341546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:00.343427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:00.343932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:00.344225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] PATH_INFO: `/v3/users/d4920157781e4b3cba0bd68f2e98ef3a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:00.345976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4920157781e4b3cba0bd68f2e98ef3a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:00.350728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fc501-2ab3-4b20-9048-d60d403bfd3d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:00.356611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf809b-1335-4c49-83cb-3017b01acbb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:00.377191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf809b-1335-4c49-83cb-3017b01acbb9 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:00.377191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf809b-1335-4c49-83cb-3017b01acbb9 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:00.377191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf809b-1335-4c49-83cb-3017b01acbb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:00.377191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf809b-1335-4c49-83cb-3017b01acbb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:00.389875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:00.468136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf809b-1335-4c49-83cb-3017b01acbb9 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:00.505656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 828/1641] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:00 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:00.662254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4920157781e4b3cba0bd68f2e98ef3a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:00.702722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4920157781e4b3cba0bd68f2e98ef3a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:00.708468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4920157781e4b3cba0bd68f2e98ef3a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:00.739856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4920157781e4b3cba0bd68f2e98ef3a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:00.833438 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4920157781e4b3cba0bd68f2e98ef3a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:00.843918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 814/1642] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:00 2022] DELETE /identity/v3/users/d4920157781e4b3cba0bd68f2e98ef3a => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:00.845644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ecaf-2d13-4a3d-8e2d-24b02c1b9318 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:00.846230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ecaf-2d13-4a3d-8e2d-24b02c1b9318 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:00.846759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4ecaf-2d13-4a3d-8e2d-24b02c1b9318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:00.921572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f8f4ecaf-2d13-4a3d-8e2d-24b02c1b9318 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:00.923487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f8f4ecaf-2d13-4a3d-8e2d-24b02c1b9318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:01.112420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 829/1643] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:01.220483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:01.222991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:01.480978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b673c8-b8b3-4a6b-b632-1800c6506022 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:01.490581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffcfe0-eb58-476e-a415-9e5635cab69a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:01.491537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffcfe0-eb58-476e-a415-9e5635cab69a service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:01.493072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffcfe0-eb58-476e-a415-9e5635cab69a service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:01.494165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffcfe0-eb58-476e-a415-9e5635cab69a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:01.518685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffcfe0-eb58-476e-a415-9e5635cab69a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:01.609330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ffcfe0-eb58-476e-a415-9e5635cab69a service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:01.653135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 815/1644] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:03.287929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38513262-21f8-4cf5-afd7-f13f271c55c0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:03.288855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38513262-21f8-4cf5-afd7-f13f271c55c0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:03.289346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38513262-21f8-4cf5-afd7-f13f271c55c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:03.313549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-38513262-21f8-4cf5-afd7-f13f271c55c0 None None] MFA Rules not processed for user `9dbcf5bc8a794a6cb12844dafc3bc9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:03.315044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-38513262-21f8-4cf5-afd7-f13f271c55c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:03.493242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 830/1645] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:03 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:04.966614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffcfe0-eb58-476e-a415-9e5635cab69a service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:04.970175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-66ffcfe0-eb58-476e-a415-9e5635cab69a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:04.990905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffcfe0-eb58-476e-a415-9e5635cab69a service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:05.012012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:05.013712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:05.014597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:05.016401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] PATH_INFO: `/v3/projects/88cc4d2f0d824d9fb00fef30d74faf40` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:05.021965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=88cc4d2f0d824d9fb00fef30d74faf40)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:05.064117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:05.275256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88cc4d2f0d824d9fb00fef30d74faf40', 'request_id': 'req-f05e9dba-e3db-4133-bd65-053da15be36a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:05.406090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88cc4d2f0d824d9fb00fef30d74faf40', 'request_id': 'req-f05e9dba-e3db-4133-bd65-053da15be36a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:05.428872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88cc4d2f0d824d9fb00fef30d74faf40', 'request_id': 'req-f05e9dba-e3db-4133-bd65-053da15be36a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:05.459794 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] The token cache is being invalidate because project 88cc4d2f0d824d9fb00fef30d74faf40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:05.460159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:05.463344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f05e9dba-e3db-4133-bd65-053da15be36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:05.470255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 816/1646] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:04 2022] DELETE /identity/v3/projects/88cc4d2f0d824d9fb00fef30d74faf40 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:05.477034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69a1bc-1edf-4258-862a-23b5d2507365 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:05.477907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69a1bc-1edf-4258-862a-23b5d2507365 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:05.478350 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69a1bc-1edf-4258-862a-23b5d2507365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:05.519468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-3c69a1bc-1edf-4258-862a-23b5d2507365 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:05.521335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3c69a1bc-1edf-4258-862a-23b5d2507365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:05.685496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 831/1647] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:05.697321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea42e-ed01-4d46-91a7-e81bc8653663 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:05.697848 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea42e-ed01-4d46-91a7-e81bc8653663 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:05.698350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ea42e-ed01-4d46-91a7-e81bc8653663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:05.728118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c35ea42e-ed01-4d46-91a7-e81bc8653663 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:05.729536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c35ea42e-ed01-4d46-91a7-e81bc8653663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:05.758988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 817/1648] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:05.763712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69a1bc-1edf-4258-862a-23b5d2507365 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:05.776701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69a1bc-1edf-4258-862a-23b5d2507365 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:05.782624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68111e3-4f9c-4e34-babb-40f1598bdf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:05.783793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68111e3-4f9c-4e34-babb-40f1598bdf93 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:05.795548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68111e3-4f9c-4e34-babb-40f1598bdf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:05.796127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68111e3-4f9c-4e34-babb-40f1598bdf93 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:05.798067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68111e3-4f9c-4e34-babb-40f1598bdf93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:10:05.802818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68111e3-4f9c-4e34-babb-40f1598bdf93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:05.846049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68111e3-4f9c-4e34-babb-40f1598bdf93 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:05.876651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 832/1649] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:10:05.882287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea42e-ed01-4d46-91a7-e81bc8653663 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:05.894590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ea42e-ed01-4d46-91a7-e81bc8653663 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:05.924970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec048d-2897-430a-85da-245ac73af657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:05.925934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec048d-2897-430a-85da-245ac73af657 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:05.927016 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec048d-2897-430a-85da-245ac73af657 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:05.927547 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec048d-2897-430a-85da-245ac73af657 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:05.928370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec048d-2897-430a-85da-245ac73af657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:06.014210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec048d-2897-430a-85da-245ac73af657 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:06.219652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 818/1650] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:05 2022] POST /identity/v3/projects => generated 381 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:06.222018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68111e3-4f9c-4e34-babb-40f1598bdf93 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:06.238049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68111e3-4f9c-4e34-babb-40f1598bdf93 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:06.375130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96c358-8cb5-4386-8246-3604c8df7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:06.375788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96c358-8cb5-4386-8246-3604c8df7df3 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:06.376073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96c358-8cb5-4386-8246-3604c8df7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:06.376412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96c358-8cb5-4386-8246-3604c8df7df3 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:06.377074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96c358-8cb5-4386-8246-3604c8df7df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:06.439478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96c358-8cb5-4386-8246-3604c8df7df3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:06.585145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 833/1651] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:06 2022] POST /identity/v3/users => generated 291 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:06.592923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec048d-2897-430a-85da-245ac73af657 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:06.606573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec048d-2897-430a-85da-245ac73af657 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:06.612548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a17d97-aec8-494d-a336-682d4caa9beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:06.613182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17d97-aec8-494d-a336-682d4caa9beb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:06.613476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17d97-aec8-494d-a336-682d4caa9beb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:06.613743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a17d97-aec8-494d-a336-682d4caa9beb admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:06.615222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a17d97-aec8-494d-a336-682d4caa9beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:06.647601 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a17d97-aec8-494d-a336-682d4caa9beb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:06.653182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d65dcc-019b-452f-87a3-b967715c8063 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:06.653531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d65dcc-019b-452f-87a3-b967715c8063 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:06.653762 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d65dcc-019b-452f-87a3-b967715c8063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:06.705415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 819/1652] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:06.713873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a17d97-aec8-494d-a336-682d4caa9beb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:06.719436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-49d65dcc-019b-452f-87a3-b967715c8063 None None] MFA Rules not processed for user `3d2197ff17dd4ed0a7b90d40b09829f0`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:06.721553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-49d65dcc-019b-452f-87a3-b967715c8063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:06.744731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a17d97-aec8-494d-a336-682d4caa9beb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:06.757912 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096a8a4-56e2-4296-8a66-f4ba301f8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:06.758760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096a8a4-56e2-4296-8a66-f4ba301f8649 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:06.759114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096a8a4-56e2-4296-8a66-f4ba301f8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:06.759410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096a8a4-56e2-4296-8a66-f4ba301f8649 admin admin] PATH_INFO: `/v3/projects/ca74c3bb1ec141ff9b76dc5b29112b12/users/85cdd99a26e041b193ac8e655d54dbea/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:06.800002 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096a8a4-56e2-4296-8a66-f4ba301f8649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca74c3bb1ec141ff9b76dc5b29112b12, user_id=85cdd99a26e041b193ac8e655d54dbea, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:06.869582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 834/1653] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:06 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:06.872071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096a8a4-56e2-4296-8a66-f4ba301f8649 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:07.002600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 820/1654] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:06 2022] PUT /identity/v3/projects/ca74c3bb1ec141ff9b76dc5b29112b12/users/85cdd99a26e041b193ac8e655d54dbea/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:07.004262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f0cab-c137-48a7-9b68-918b74bf0032 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:07.005781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f0cab-c137-48a7-9b68-918b74bf0032 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:07.005781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f0cab-c137-48a7-9b68-918b74bf0032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:07.110374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-052f0cab-c137-48a7-9b68-918b74bf0032 None None] MFA Rules not processed for user `85cdd99a26e041b193ac8e655d54dbea`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:07.111684 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-052f0cab-c137-48a7-9b68-918b74bf0032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:07.384850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 835/1655] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:07 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:07.388768 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096a8a4-56e2-4296-8a66-f4ba301f8649 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:07.583552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096a8a4-56e2-4296-8a66-f4ba301f8649 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:07.591138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb42bd0-2456-4c41-8255-9f0e1906e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:07.592616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb42bd0-2456-4c41-8255-9f0e1906e773 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:07.593183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb42bd0-2456-4c41-8255-9f0e1906e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:07.593607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb42bd0-2456-4c41-8255-9f0e1906e773 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:07.594767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb42bd0-2456-4c41-8255-9f0e1906e773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:07.645753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb42bd0-2456-4c41-8255-9f0e1906e773 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:08.763809 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 821/1656] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:07 2022] POST /identity/v3/projects => generated 381 bytes in 1354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:08.764809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f0cab-c137-48a7-9b68-918b74bf0032 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:08.777003 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f0cab-c137-48a7-9b68-918b74bf0032 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:08.850044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726ad6-bb37-431f-9f45-3cb242dea7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:08.850645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726ad6-bb37-431f-9f45-3cb242dea7cb admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:08.850936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726ad6-bb37-431f-9f45-3cb242dea7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:08.851221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80726ad6-bb37-431f-9f45-3cb242dea7cb admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:08.851904 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80726ad6-bb37-431f-9f45-3cb242dea7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:08.878337 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80726ad6-bb37-431f-9f45-3cb242dea7cb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:09.641478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 836/1657] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:08 2022] POST /identity/v3/users => generated 297 bytes in 877 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:09.647720 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb42bd0-2456-4c41-8255-9f0e1906e773 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:09.662999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb42bd0-2456-4c41-8255-9f0e1906e773 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:09.668067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de79c4c-226c-40e2-ba05-cf86f27c6364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:09.668799 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de79c4c-226c-40e2-ba05-cf86f27c6364 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:09.669084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de79c4c-226c-40e2-ba05-cf86f27c6364 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:09.669527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de79c4c-226c-40e2-ba05-cf86f27c6364 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:09.670236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de79c4c-226c-40e2-ba05-cf86f27c6364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:09.699212 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de79c4c-226c-40e2-ba05-cf86f27c6364 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:09.711534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 822/1658] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:09.717951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726ad6-bb37-431f-9f45-3cb242dea7cb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:09.734576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80726ad6-bb37-431f-9f45-3cb242dea7cb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:09.741181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074524-121e-47ec-aabe-f3a07dc63208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:09.742145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074524-121e-47ec-aabe-f3a07dc63208 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:09.742444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074524-121e-47ec-aabe-f3a07dc63208 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:09.742730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074524-121e-47ec-aabe-f3a07dc63208 admin admin] PATH_INFO: `/v3/projects/9dfa35a6a97746fbac9279f5d5a4430c/users/5a818c70d56446e490336fbbf93038a9/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:09.769835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51074524-121e-47ec-aabe-f3a07dc63208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa35a6a97746fbac9279f5d5a4430c, user_id=5a818c70d56446e490336fbbf93038a9, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:09.804582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51074524-121e-47ec-aabe-f3a07dc63208 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:09.916599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 837/1659] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:09 2022] PUT /identity/v3/projects/9dfa35a6a97746fbac9279f5d5a4430c/users/5a818c70d56446e490336fbbf93038a9/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:09.920686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de79c4c-226c-40e2-ba05-cf86f27c6364 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:09.934246 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de79c4c-226c-40e2-ba05-cf86f27c6364 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:10.039291 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380d9d-f2af-472b-ab37-3ebe33b30865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:10.042816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380d9d-f2af-472b-ab37-3ebe33b30865 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:10.042816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380d9d-f2af-472b-ab37-3ebe33b30865 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:10.043114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88380d9d-f2af-472b-ab37-3ebe33b30865 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:10.045101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88380d9d-f2af-472b-ab37-3ebe33b30865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:10.084146 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88380d9d-f2af-472b-ab37-3ebe33b30865 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:10.105400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 823/1660] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:10:10.105734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074524-121e-47ec-aabe-f3a07dc63208 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:10.112860 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074524-121e-47ec-aabe-f3a07dc63208 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:10.117719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dd2aa-6515-47a8-80b1-78a38cdc1e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:10.118597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dd2aa-6515-47a8-80b1-78a38cdc1e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:10.118953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dd2aa-6515-47a8-80b1-78a38cdc1e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:10.119223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dd2aa-6515-47a8-80b1-78a38cdc1e8e admin admin] PATH_INFO: `/v3/projects/9dfa35a6a97746fbac9279f5d5a4430c/users/5a818c70d56446e490336fbbf93038a9/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:10.121255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dd2aa-6515-47a8-80b1-78a38cdc1e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa35a6a97746fbac9279f5d5a4430c, user_id=5a818c70d56446e490336fbbf93038a9, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:10.150677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dd2aa-6515-47a8-80b1-78a38cdc1e8e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:10.162985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 838/1661] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:10 2022] PUT /identity/v3/projects/9dfa35a6a97746fbac9279f5d5a4430c/users/5a818c70d56446e490336fbbf93038a9/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:10.167079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380d9d-f2af-472b-ab37-3ebe33b30865 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:10.185031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88380d9d-f2af-472b-ab37-3ebe33b30865 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:10.253122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deec802-140d-4440-a9cf-ac04ceb052a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:10.253810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deec802-140d-4440-a9cf-ac04ceb052a0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:10.255117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deec802-140d-4440-a9cf-ac04ceb052a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:10.255360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deec802-140d-4440-a9cf-ac04ceb052a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:10.256087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deec802-140d-4440-a9cf-ac04ceb052a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:10.282383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deec802-140d-4440-a9cf-ac04ceb052a0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:10.294287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 824/1662] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:10.298870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dd2aa-6515-47a8-80b1-78a38cdc1e8e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:10.309978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dd2aa-6515-47a8-80b1-78a38cdc1e8e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:10.316050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660af458-e2bb-44da-89ce-a68c534dfcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:10.318572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af458-e2bb-44da-89ce-a68c534dfcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:10.318881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af458-e2bb-44da-89ce-a68c534dfcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:10.319169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af458-e2bb-44da-89ce-a68c534dfcc6 admin admin] PATH_INFO: `/v3/projects/9dfa35a6a97746fbac9279f5d5a4430c/users/5a818c70d56446e490336fbbf93038a9/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:10.325512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660af458-e2bb-44da-89ce-a68c534dfcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dfa35a6a97746fbac9279f5d5a4430c, user_id=5a818c70d56446e490336fbbf93038a9, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:10.363547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660af458-e2bb-44da-89ce-a68c534dfcc6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:10.485664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 839/1663] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:10 2022] PUT /identity/v3/projects/9dfa35a6a97746fbac9279f5d5a4430c/users/5a818c70d56446e490336fbbf93038a9/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:10.498270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3786da8-65ac-48bd-8326-4a9bea7be90d None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:10.498565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3786da8-65ac-48bd-8326-4a9bea7be90d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:10.498849 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3786da8-65ac-48bd-8326-4a9bea7be90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:10.552289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c3786da8-65ac-48bd-8326-4a9bea7be90d None None] MFA Rules not processed for user `5a818c70d56446e490336fbbf93038a9`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:10.556648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c3786da8-65ac-48bd-8326-4a9bea7be90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:10.639117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 825/1664] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:10 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:10.650079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660af458-e2bb-44da-89ce-a68c534dfcc6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:10.651785 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-660af458-e2bb-44da-89ce-a68c534dfcc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:10.736853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660af458-e2bb-44da-89ce-a68c534dfcc6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:10.741420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec24762-7985-48c4-81a5-4ae066b93d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:10.746989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec24762-7985-48c4-81a5-4ae066b93d30 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:10.746989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec24762-7985-48c4-81a5-4ae066b93d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:10.746989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec24762-7985-48c4-81a5-4ae066b93d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:10.753418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec24762-7985-48c4-81a5-4ae066b93d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:10.782192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec24762-7985-48c4-81a5-4ae066b93d30 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:10.797286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 840/1665] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:10 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:11.074510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3786da8-65ac-48bd-8326-4a9bea7be90d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:11.076289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c3786da8-65ac-48bd-8326-4a9bea7be90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:11.250889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3786da8-65ac-48bd-8326-4a9bea7be90d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:11.253568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec24762-7985-48c4-81a5-4ae066b93d30 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:11.257195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:11.258056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:11.258343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:11.258625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] PATH_INFO: `/v3/users/8b1a721f59ff42fdaa7e346017c72a96` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:11.259798 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1a721f59ff42fdaa7e346017c72a96)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:11.266216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec24762-7985-48c4-81a5-4ae066b93d30 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:11.277781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f49bb-405c-45ba-85c4-5794f5b8aa18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:11.278716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f49bb-405c-45ba-85c4-5794f5b8aa18 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:11.279539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f49bb-405c-45ba-85c4-5794f5b8aa18 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:11.279539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f49bb-405c-45ba-85c4-5794f5b8aa18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:11.288844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:11.390577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f49bb-405c-45ba-85c4-5794f5b8aa18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:11.422855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f49bb-405c-45ba-85c4-5794f5b8aa18 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:11.439979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 841/1666] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:11 2022] GET /identity/v3/auth/tokens => generated 3688 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:10:11.650868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1a721f59ff42fdaa7e346017c72a96'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:11.664850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1a721f59ff42fdaa7e346017c72a96'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:11.665973 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1a721f59ff42fdaa7e346017c72a96'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:11.674277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1a721f59ff42fdaa7e346017c72a96'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:11.810231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1a721f59ff42fdaa7e346017c72a96'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:11.817495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 826/1667] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:11 2022] DELETE /identity/v3/users/8b1a721f59ff42fdaa7e346017c72a96 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:11.822253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693487e1-db84-4982-b86a-86747a9e2132 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:11.822730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693487e1-db84-4982-b86a-86747a9e2132 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:11.822860 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693487e1-db84-4982-b86a-86747a9e2132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:11.845434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-693487e1-db84-4982-b86a-86747a9e2132 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:11.846637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-693487e1-db84-4982-b86a-86747a9e2132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:11.945905 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 842/1668] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:11.960819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:11.962826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:12.122242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106acc72-06f5-4df5-bce9-7e106773c061 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:12.128784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d82db-69c4-4bb3-bf12-b723605a3572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:12.129795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d82db-69c4-4bb3-bf12-b723605a3572 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:12.130397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d82db-69c4-4bb3-bf12-b723605a3572 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:12.130893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d82db-69c4-4bb3-bf12-b723605a3572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:12.143482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d82db-69c4-4bb3-bf12-b723605a3572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:12.205916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d82db-69c4-4bb3-bf12-b723605a3572 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:12.231477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 827/1669] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:13.265439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693487e1-db84-4982-b86a-86747a9e2132 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:13.267353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-693487e1-db84-4982-b86a-86747a9e2132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:13.287215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693487e1-db84-4982-b86a-86747a9e2132 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:13.300721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:13.306702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:13.306702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:13.306702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] PATH_INFO: `/v3/projects/485d07b093714f799748f7230f4f424c` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:13.306702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485d07b093714f799748f7230f4f424c)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:13.352209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:13.486314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485d07b093714f799748f7230f4f424c', 'request_id': 'req-2f309749-72b2-4f8d-b0bd-2c7347905d08'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:13.587858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485d07b093714f799748f7230f4f424c', 'request_id': 'req-2f309749-72b2-4f8d-b0bd-2c7347905d08'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:13.604407 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485d07b093714f799748f7230f4f424c', 'request_id': 'req-2f309749-72b2-4f8d-b0bd-2c7347905d08'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:13.628331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] The token cache is being invalidate because project 485d07b093714f799748f7230f4f424c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:13.629334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:13.631597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2f309749-72b2-4f8d-b0bd-2c7347905d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:13.633738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 843/1670] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:13 2022] DELETE /identity/v3/projects/485d07b093714f799748f7230f4f424c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:13.640149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f240d-77b2-40f8-bfdb-339555ff77ec None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:13.644118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f240d-77b2-40f8-bfdb-339555ff77ec None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:13.644118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f240d-77b2-40f8-bfdb-339555ff77ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:13.674920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f18f240d-77b2-40f8-bfdb-339555ff77ec None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:13.692875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f18f240d-77b2-40f8-bfdb-339555ff77ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:13.788265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 828/1671] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:13.797024 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a839c-271b-429b-922f-241591335ad5 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:13.797985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a839c-271b-429b-922f-241591335ad5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:13.798839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a839c-271b-429b-922f-241591335ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:13.826677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7c6a839c-271b-429b-922f-241591335ad5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:13.828091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7c6a839c-271b-429b-922f-241591335ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:13.836842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 844/1672] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:13.841692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f240d-77b2-40f8-bfdb-339555ff77ec None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:13.855109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f240d-77b2-40f8-bfdb-339555ff77ec None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:13.860100 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f82c49-66af-48c8-b47c-178917a9cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:13.860719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82c49-66af-48c8-b47c-178917a9cbbe admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:13.861009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82c49-66af-48c8-b47c-178917a9cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:13.861291 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f82c49-66af-48c8-b47c-178917a9cbbe admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:13.861995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f82c49-66af-48c8-b47c-178917a9cbbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:10:13.862293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f82c49-66af-48c8-b47c-178917a9cbbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:13.889891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f82c49-66af-48c8-b47c-178917a9cbbe admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:13.910267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a839c-271b-429b-922f-241591335ad5 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:13.919420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 829/1673] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:10:13.935537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a839c-271b-429b-922f-241591335ad5 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:13.941210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb798e-6fde-4828-93bb-9a4d2311e65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:13.942899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb798e-6fde-4828-93bb-9a4d2311e65e admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:13.943659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb798e-6fde-4828-93bb-9a4d2311e65e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:13.944113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb798e-6fde-4828-93bb-9a4d2311e65e admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:13.944943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb798e-6fde-4828-93bb-9a4d2311e65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:13.975260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb798e-6fde-4828-93bb-9a4d2311e65e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:14.117560 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 845/1674] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:13 2022] POST /identity/v3/projects => generated 405 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:10:14.124847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f82c49-66af-48c8-b47c-178917a9cbbe admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:14.149754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f82c49-66af-48c8-b47c-178917a9cbbe admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:14.344390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e4b24-d6e5-4606-8c9a-4b58a27d0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:14.345109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e4b24-d6e5-4606-8c9a-4b58a27d0459 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:14.345406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e4b24-d6e5-4606-8c9a-4b58a27d0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:14.345763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e4b24-d6e5-4606-8c9a-4b58a27d0459 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:14.346479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e4b24-d6e5-4606-8c9a-4b58a27d0459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:14.421802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e4b24-d6e5-4606-8c9a-4b58a27d0459 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:14.570788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 830/1675] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:14 2022] POST /identity/v3/users => generated 303 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:14.575353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb798e-6fde-4828-93bb-9a4d2311e65e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:14.586634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb798e-6fde-4828-93bb-9a4d2311e65e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:14.603005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538aa8b2-8b17-4a5e-96d4-0daf118bd5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:14.603650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aa8b2-8b17-4a5e-96d4-0daf118bd5ba admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:14.603941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aa8b2-8b17-4a5e-96d4-0daf118bd5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:14.604373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538aa8b2-8b17-4a5e-96d4-0daf118bd5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:14.605395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aa8b2-8b17-4a5e-96d4-0daf118bd5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:14.642404 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538aa8b2-8b17-4a5e-96d4-0daf118bd5ba admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:14.656794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 846/1676] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:10:14.661741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e4b24-d6e5-4606-8c9a-4b58a27d0459 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:14.697090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e4b24-d6e5-4606-8c9a-4b58a27d0459 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:14.697090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443098c4-cc1e-40ce-a636-5120a49a1cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:14.697090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443098c4-cc1e-40ce-a636-5120a49a1cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:14.697090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443098c4-cc1e-40ce-a636-5120a49a1cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:14.697384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443098c4-cc1e-40ce-a636-5120a49a1cdc admin admin] PATH_INFO: `/v3/projects/fd2cd9914aa242ad84e257b772033710/users/c69630b755f9463884c6ec5413adf951/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:14.745086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443098c4-cc1e-40ce-a636-5120a49a1cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2cd9914aa242ad84e257b772033710, user_id=c69630b755f9463884c6ec5413adf951, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:14.773400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443098c4-cc1e-40ce-a636-5120a49a1cdc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:14.908194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 831/1677] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:14 2022] PUT /identity/v3/projects/fd2cd9914aa242ad84e257b772033710/users/c69630b755f9463884c6ec5413adf951/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:14.914791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf774c6-dcd0-415c-b22c-5417721d0afb None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:14.914791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf774c6-dcd0-415c-b22c-5417721d0afb None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:14.914791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf774c6-dcd0-415c-b22c-5417721d0afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:14.965475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-cdf774c6-dcd0-415c-b22c-5417721d0afb None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:14.966716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cdf774c6-dcd0-415c-b22c-5417721d0afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:15.097701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 847/1678] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:15.172829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443098c4-cc1e-40ce-a636-5120a49a1cdc admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:15.174804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-443098c4-cc1e-40ce-a636-5120a49a1cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:15.289260 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443098c4-cc1e-40ce-a636-5120a49a1cdc admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:15.302277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29ebf5-9eb6-46e6-a073-522f1e699d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:15.303195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ebf5-9eb6-46e6-a073-522f1e699d2f service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:15.304000 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ebf5-9eb6-46e6-a073-522f1e699d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:15.304457 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29ebf5-9eb6-46e6-a073-522f1e699d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:15.319825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29ebf5-9eb6-46e6-a073-522f1e699d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:15.356742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29ebf5-9eb6-46e6-a073-522f1e699d2f service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:15.371738 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 832/1679] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:15 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:17.947274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d1abb-b911-4351-af73-6e8cdda0e6ab None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:17.948241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d1abb-b911-4351-af73-6e8cdda0e6ab None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:17.948749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d1abb-b911-4351-af73-6e8cdda0e6ab None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:17.953001 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 848/1680] 10.222.0.87 () {54 vars in 921 bytes} [Tue Jan 18 13:10:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:10:17.966830 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998864bf-0d2e-4825-a889-0f968b50516b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:17.967373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998864bf-0d2e-4825-a889-0f968b50516b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:17.967947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998864bf-0d2e-4825-a889-0f968b50516b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:18.003700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-998864bf-0d2e-4825-a889-0f968b50516b None None] MFA Rules not processed for user `394a96c082ed47bbbd645b489a4ed208`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:18.005333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-998864bf-0d2e-4825-a889-0f968b50516b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:18.198688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 833/1681] 10.222.0.87 () {58 vars in 1018 bytes} [Tue Jan 18 13:10:17 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:18.293148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d1abb-b911-4351-af73-6e8cdda0e6ab None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:18.295433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-241d1abb-b911-4351-af73-6e8cdda0e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:18.322461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d1abb-b911-4351-af73-6e8cdda0e6ab None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:18.328323 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7105a8f-e786-4689-925b-b84f681ca5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:18.329211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7105a8f-e786-4689-925b-b84f681ca5b4 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:18.329657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7105a8f-e786-4689-925b-b84f681ca5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:18.330084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7105a8f-e786-4689-925b-b84f681ca5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:18.340396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7105a8f-e786-4689-925b-b84f681ca5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:18.368417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7105a8f-e786-4689-925b-b84f681ca5b4 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:18.380591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 849/1682] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:18 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:18.901236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783462c6-db4b-4e8f-91ee-48cb5055bd13 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:18.901527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783462c6-db4b-4e8f-91ee-48cb5055bd13 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:18.901820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783462c6-db4b-4e8f-91ee-48cb5055bd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:18.942310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-783462c6-db4b-4e8f-91ee-48cb5055bd13 None None] MFA Rules not processed for user `c69630b755f9463884c6ec5413adf951`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:18.943623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-783462c6-db4b-4e8f-91ee-48cb5055bd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:19.024771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 834/1683] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:18 2022] POST /identity/v3/auth/tokens => generated 3712 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:19.029255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7105a8f-e786-4689-925b-b84f681ca5b4 service nova] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:19.051880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7105a8f-e786-4689-925b-b84f681ca5b4 service nova] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:19.059824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3113c3b-6fd5-42b0-ac6a-24829b635a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:19.060687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3113c3b-6fd5-42b0-ac6a-24829b635a68 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:19.061164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3113c3b-6fd5-42b0-ac6a-24829b635a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:19.061594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3113c3b-6fd5-42b0-ac6a-24829b635a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:19.062436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3113c3b-6fd5-42b0-ac6a-24829b635a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:19.095703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3113c3b-6fd5-42b0-ac6a-24829b635a68 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:19.202531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 850/1684] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:19 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:19.209675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783462c6-db4b-4e8f-91ee-48cb5055bd13 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:19.221130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783462c6-db4b-4e8f-91ee-48cb5055bd13 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:19.317070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ace8f-d9d3-4f28-b66b-2829bc2cd541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:19.317695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ace8f-d9d3-4f28-b66b-2829bc2cd541 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:19.317980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ace8f-d9d3-4f28-b66b-2829bc2cd541 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:19.318261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ace8f-d9d3-4f28-b66b-2829bc2cd541 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:19.318913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ace8f-d9d3-4f28-b66b-2829bc2cd541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:19.345135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ace8f-d9d3-4f28-b66b-2829bc2cd541 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:19.443110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 835/1685] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:19 2022] POST /identity/v3/users => generated 309 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:19.444374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3113c3b-6fd5-42b0-ac6a-24829b635a68 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:19.456678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3113c3b-6fd5-42b0-ac6a-24829b635a68 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:19.462131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b16e-9feb-45ed-b391-c676fe9fe3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:19.462831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b16e-9feb-45ed-b391-c676fe9fe3ee admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:19.463186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b16e-9feb-45ed-b391-c676fe9fe3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:19.463796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44b16e-9feb-45ed-b391-c676fe9fe3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:19.464567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44b16e-9feb-45ed-b391-c676fe9fe3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:19.491467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44b16e-9feb-45ed-b391-c676fe9fe3ee admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:19.502769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 851/1686] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:19.508766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ace8f-d9d3-4f28-b66b-2829bc2cd541 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:19.520755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ace8f-d9d3-4f28-b66b-2829bc2cd541 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:19.526238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b11aff-4d9c-4b1b-959b-e10494369da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:19.527072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b11aff-4d9c-4b1b-959b-e10494369da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:19.527390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b11aff-4d9c-4b1b-959b-e10494369da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:19.527672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b11aff-4d9c-4b1b-959b-e10494369da0 admin admin] PATH_INFO: `/v3/projects/9d4a028390e7411e85e2e464feceff45/users/b1a82dfc14d94e7a806edf78af2c5beb/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:19.549052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b11aff-4d9c-4b1b-959b-e10494369da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4a028390e7411e85e2e464feceff45, user_id=b1a82dfc14d94e7a806edf78af2c5beb, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:19.576788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b11aff-4d9c-4b1b-959b-e10494369da0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:19.656381 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 836/1687] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:19 2022] PUT /identity/v3/projects/9d4a028390e7411e85e2e464feceff45/users/b1a82dfc14d94e7a806edf78af2c5beb/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:19.660802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b16e-9feb-45ed-b391-c676fe9fe3ee admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:19.672693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44b16e-9feb-45ed-b391-c676fe9fe3ee admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:19.739686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b526b4f-dff4-4454-b0a4-0107b36d22d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:19.740446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b526b4f-dff4-4454-b0a4-0107b36d22d8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:19.740734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b526b4f-dff4-4454-b0a4-0107b36d22d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:19.741013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b526b4f-dff4-4454-b0a4-0107b36d22d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:19.741710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b526b4f-dff4-4454-b0a4-0107b36d22d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:19.768020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b526b4f-dff4-4454-b0a4-0107b36d22d8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:19.779792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 852/1688] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:19.784095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b11aff-4d9c-4b1b-959b-e10494369da0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:19.794732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b11aff-4d9c-4b1b-959b-e10494369da0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:19.799202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aad0ac-9067-42b7-9b16-b651b9e0857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:19.800151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aad0ac-9067-42b7-9b16-b651b9e0857e admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:19.800513 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aad0ac-9067-42b7-9b16-b651b9e0857e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:19.800915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aad0ac-9067-42b7-9b16-b651b9e0857e admin admin] PATH_INFO: `/v3/projects/9d4a028390e7411e85e2e464feceff45/users/b1a82dfc14d94e7a806edf78af2c5beb/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:19.802990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aad0ac-9067-42b7-9b16-b651b9e0857e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4a028390e7411e85e2e464feceff45, user_id=b1a82dfc14d94e7a806edf78af2c5beb, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:19.830185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aad0ac-9067-42b7-9b16-b651b9e0857e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:19.841631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 837/1689] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:19 2022] PUT /identity/v3/projects/9d4a028390e7411e85e2e464feceff45/users/b1a82dfc14d94e7a806edf78af2c5beb/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:19.845759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b526b4f-dff4-4454-b0a4-0107b36d22d8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:19.855761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b526b4f-dff4-4454-b0a4-0107b36d22d8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:19.943790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18619b8a-49b6-409c-a72c-c11376976b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:19.944401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18619b8a-49b6-409c-a72c-c11376976b98 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:19.944699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18619b8a-49b6-409c-a72c-c11376976b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:19.944991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18619b8a-49b6-409c-a72c-c11376976b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:19.945688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18619b8a-49b6-409c-a72c-c11376976b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:19.972042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18619b8a-49b6-409c-a72c-c11376976b98 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:19.983973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 853/1690] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:19.988831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aad0ac-9067-42b7-9b16-b651b9e0857e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:19.998595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aad0ac-9067-42b7-9b16-b651b9e0857e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:20.002766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d0cd8-dcab-486b-9f90-9247faa18e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:20.003596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d0cd8-dcab-486b-9f90-9247faa18e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:20.003879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d0cd8-dcab-486b-9f90-9247faa18e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:20.004764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d0cd8-dcab-486b-9f90-9247faa18e77 admin admin] PATH_INFO: `/v3/projects/9d4a028390e7411e85e2e464feceff45/users/b1a82dfc14d94e7a806edf78af2c5beb/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:20.006658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d0cd8-dcab-486b-9f90-9247faa18e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4a028390e7411e85e2e464feceff45, user_id=b1a82dfc14d94e7a806edf78af2c5beb, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:20.033685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d0cd8-dcab-486b-9f90-9247faa18e77 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:20.115199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 838/1691] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:19 2022] PUT /identity/v3/projects/9d4a028390e7411e85e2e464feceff45/users/b1a82dfc14d94e7a806edf78af2c5beb/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:22.869300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b25c79-0d8e-4fa1-a9d8-b8f1eb983c9d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:22.869826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b25c79-0d8e-4fa1-a9d8-b8f1eb983c9d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:22.870046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b25c79-0d8e-4fa1-a9d8-b8f1eb983c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:22.970605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-95b25c79-0d8e-4fa1-a9d8-b8f1eb983c9d None None] MFA Rules not processed for user `b1a82dfc14d94e7a806edf78af2c5beb`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:22.975019 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-95b25c79-0d8e-4fa1-a9d8-b8f1eb983c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:23.216593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 854/1692] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:22 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:23.587362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8caa2b-6543-4734-9352-1973f831f25b None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:23.588747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8caa2b-6543-4734-9352-1973f831f25b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:23.589633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8caa2b-6543-4734-9352-1973f831f25b None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:23.592480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 839/1693] 10.222.0.87 () {54 vars in 921 bytes} [Tue Jan 18 13:10:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:10:23.601167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b71454-02bf-41cf-8e99-f01f1fee6503 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:23.602300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b71454-02bf-41cf-8e99-f01f1fee6503 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:23.602602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b71454-02bf-41cf-8e99-f01f1fee6503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:23.636036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f5b71454-02bf-41cf-8e99-f01f1fee6503 None None] MFA Rules not processed for user `394a96c082ed47bbbd645b489a4ed208`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:23.650313 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f5b71454-02bf-41cf-8e99-f01f1fee6503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:23.754823 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 855/1694] 10.222.0.87 () {58 vars in 1018 bytes} [Tue Jan 18 13:10:23 2022] POST /identity/v3/auth/tokens => generated 3802 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:23.831029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8caa2b-6543-4734-9352-1973f831f25b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:23.834378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6b8caa2b-6543-4734-9352-1973f831f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:23.860977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8caa2b-6543-4734-9352-1973f831f25b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:23.868187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738d4dc-65a3-4068-a010-5333cf02cd79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:23.869159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738d4dc-65a3-4068-a010-5333cf02cd79 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:23.869656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738d4dc-65a3-4068-a010-5333cf02cd79 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:23.870159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738d4dc-65a3-4068-a010-5333cf02cd79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:23.881337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738d4dc-65a3-4068-a010-5333cf02cd79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:23.908651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c738d4dc-65a3-4068-a010-5333cf02cd79 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:23.920264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 840/1695] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:23 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:26.408561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b71454-02bf-41cf-8e99-f01f1fee6503 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:26.495062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b71454-02bf-41cf-8e99-f01f1fee6503 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:26.499906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:26.502255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:26.512880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:26.513287 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] PATH_INFO: `/v3/users/c69630b755f9463884c6ec5413adf951` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:26.517217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69630b755f9463884c6ec5413adf951)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:26.544558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:26.835229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69630b755f9463884c6ec5413adf951'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:26.835919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69630b755f9463884c6ec5413adf951'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:26.844985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69630b755f9463884c6ec5413adf951'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:26.860210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69630b755f9463884c6ec5413adf951'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:27.051902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69630b755f9463884c6ec5413adf951'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:27.062497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 856/1696] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:26 2022] DELETE /identity/v3/users/c69630b755f9463884c6ec5413adf951 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:27.422292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738d4dc-65a3-4068-a010-5333cf02cd79 service nova] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:27.440488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738d4dc-65a3-4068-a010-5333cf02cd79 service nova] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:27.528292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:27.529565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:27.530153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:27.530588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] PATH_INFO: `/v3/projects/fd2cd9914aa242ad84e257b772033710` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:27.532371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2cd9914aa242ad84e257b772033710)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:27.564748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:27.780935 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2cd9914aa242ad84e257b772033710', 'request_id': 'req-a87b2ec1-9351-46bc-87c7-75989dfd7225'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:27.935538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2cd9914aa242ad84e257b772033710', 'request_id': 'req-a87b2ec1-9351-46bc-87c7-75989dfd7225'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:27.949784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2cd9914aa242ad84e257b772033710', 'request_id': 'req-a87b2ec1-9351-46bc-87c7-75989dfd7225'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:27.960603 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] The token cache is being invalidate because project fd2cd9914aa242ad84e257b772033710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:27.960866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:27.961497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:27.963120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 841/1697] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:27 2022] DELETE /identity/v3/projects/fd2cd9914aa242ad84e257b772033710 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:27.968443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:27.968443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:27.981719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f975d-66b2-47a4-9256-e1192e942db0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:28.049658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:28.050674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:28.052406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:28.052764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] PATH_INFO: `/v3/users/b1a82dfc14d94e7a806edf78af2c5beb` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:28.054158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a82dfc14d94e7a806edf78af2c5beb)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:28.081855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:28.288409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a82dfc14d94e7a806edf78af2c5beb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:28.289427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a82dfc14d94e7a806edf78af2c5beb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:28.297004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a82dfc14d94e7a806edf78af2c5beb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:28.310945 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a82dfc14d94e7a806edf78af2c5beb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:28.346339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:28.347854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:28.359954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2ec1-9351-46bc-87c7-75989dfd7225 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:28.365011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:28.365813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:28.366096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:28.366376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] PATH_INFO: `/v3/users/85cdd99a26e041b193ac8e655d54dbea` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:28.367481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=85cdd99a26e041b193ac8e655d54dbea)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:28.393029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a82dfc14d94e7a806edf78af2c5beb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:28.395258 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:28.401626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 857/1698] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:27 2022] DELETE /identity/v3/users/b1a82dfc14d94e7a806edf78af2c5beb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:28.836270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85cdd99a26e041b193ac8e655d54dbea'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:28.850294 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85cdd99a26e041b193ac8e655d54dbea'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:28.851519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85cdd99a26e041b193ac8e655d54dbea'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:28.861349 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85cdd99a26e041b193ac8e655d54dbea'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:28.908384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:28.909744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:28.998864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a4d51c9b-a113-436d-854a-208a04482ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85cdd99a26e041b193ac8e655d54dbea'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:29.005137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60726dac-f00d-49c4-8080-ecb95c5d0944 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:29.010701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 842/1699] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:28 2022] DELETE /identity/v3/users/85cdd99a26e041b193ac8e655d54dbea => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:29.014314 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff42ef-dc9c-4717-8ada-60b7ebd4935b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:29.015384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff42ef-dc9c-4717-8ada-60b7ebd4935b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:29.015672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff42ef-dc9c-4717-8ada-60b7ebd4935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:29.023610 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:29.024443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:29.024785 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:29.025018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] PATH_INFO: `/v3/projects/9d4a028390e7411e85e2e464feceff45` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:29.030084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4a028390e7411e85e2e464feceff45)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:29.058539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-dbff42ef-dc9c-4717-8ada-60b7ebd4935b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:29.063152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dbff42ef-dc9c-4717-8ada-60b7ebd4935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:29.069495 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:29.160645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 843/1700] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:29.172337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff42ef-dc9c-4717-8ada-60b7ebd4935b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:29.173653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dbff42ef-dc9c-4717-8ada-60b7ebd4935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:29.238659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff42ef-dc9c-4717-8ada-60b7ebd4935b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:29.242018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9484ac1-3ff4-4900-9184-2eaf1b289bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:29.242599 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9484ac1-3ff4-4900-9184-2eaf1b289bfd service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:29.242919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9484ac1-3ff4-4900-9184-2eaf1b289bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:29.243170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9484ac1-3ff4-4900-9184-2eaf1b289bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:29.252647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9484ac1-3ff4-4900-9184-2eaf1b289bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:29.278714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9484ac1-3ff4-4900-9184-2eaf1b289bfd service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:29.289227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 844/1701] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:29 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:10:29.338142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4a028390e7411e85e2e464feceff45', 'request_id': 'req-4bd9453f-5748-4c95-aae3-da51a8ee9513'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:29.467546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4a028390e7411e85e2e464feceff45', 'request_id': 'req-4bd9453f-5748-4c95-aae3-da51a8ee9513'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:29.480888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4a028390e7411e85e2e464feceff45', 'request_id': 'req-4bd9453f-5748-4c95-aae3-da51a8ee9513'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:29.492927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] The token cache is being invalidate because project 9d4a028390e7411e85e2e464feceff45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:29.493359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:29.494184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4bd9453f-5748-4c95-aae3-da51a8ee9513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:29.495811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 858/1702] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:28 2022] DELETE /identity/v3/projects/9d4a028390e7411e85e2e464feceff45 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:29.501835 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0bfb2-0040-4ad2-9d1c-6bb7040444bf None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:29.502203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0bfb2-0040-4ad2-9d1c-6bb7040444bf None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:29.502555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0bfb2-0040-4ad2-9d1c-6bb7040444bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:29.527745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-88e0bfb2-0040-4ad2-9d1c-6bb7040444bf None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:29.528840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-88e0bfb2-0040-4ad2-9d1c-6bb7040444bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:29.621621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 845/1703] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:29.630074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2bfc1-bea1-4fa3-8331-a13ff48b5383 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:29.630373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2bfc1-bea1-4fa3-8331-a13ff48b5383 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:29.630662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2bfc1-bea1-4fa3-8331-a13ff48b5383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:29.655108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f6b2bfc1-bea1-4fa3-8331-a13ff48b5383 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:29.656465 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f6b2bfc1-bea1-4fa3-8331-a13ff48b5383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:29.665526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 859/1704] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:29.669633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0bfb2-0040-4ad2-9d1c-6bb7040444bf None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:29.681911 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0bfb2-0040-4ad2-9d1c-6bb7040444bf None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:29.686279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03011d7a-cf92-49d0-af01-2cdbb86252a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:29.687025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03011d7a-cf92-49d0-af01-2cdbb86252a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:29.687489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03011d7a-cf92-49d0-af01-2cdbb86252a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:29.687797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03011d7a-cf92-49d0-af01-2cdbb86252a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:29.688495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03011d7a-cf92-49d0-af01-2cdbb86252a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:10:29.689228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03011d7a-cf92-49d0-af01-2cdbb86252a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:29.716536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03011d7a-cf92-49d0-af01-2cdbb86252a1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:29.733330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 846/1705] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:10:29.739839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2bfc1-bea1-4fa3-8331-a13ff48b5383 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:29.749654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2bfc1-bea1-4fa3-8331-a13ff48b5383 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:29.754454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e784e6-6468-46ee-8216-2f09a39d4379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:29.761427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e784e6-6468-46ee-8216-2f09a39d4379 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:29.761427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e784e6-6468-46ee-8216-2f09a39d4379 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:29.761427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e784e6-6468-46ee-8216-2f09a39d4379 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:29.761427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e784e6-6468-46ee-8216-2f09a39d4379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:29.786552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e784e6-6468-46ee-8216-2f09a39d4379 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:29.932106 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 860/1706] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:29 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:29.935948 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03011d7a-cf92-49d0-af01-2cdbb86252a1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:29.955110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03011d7a-cf92-49d0-af01-2cdbb86252a1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:30.038362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45404eb6-2600-4a76-b4bc-12a60b86c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:30.039347 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45404eb6-2600-4a76-b4bc-12a60b86c8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:30.039837 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45404eb6-2600-4a76-b4bc-12a60b86c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:30.040293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45404eb6-2600-4a76-b4bc-12a60b86c8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:30.041129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45404eb6-2600-4a76-b4bc-12a60b86c8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:30.073892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45404eb6-2600-4a76-b4bc-12a60b86c8b7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:30.297918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 847/1707] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:29 2022] POST /identity/v3/users => generated 286 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:30.306384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e784e6-6468-46ee-8216-2f09a39d4379 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:30.322223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e784e6-6468-46ee-8216-2f09a39d4379 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:30.334058 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45404eb6-2600-4a76-b4bc-12a60b86c8b7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:30.335837 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-45404eb6-2600-4a76-b4bc-12a60b86c8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:30.364621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4413c-53ff-43e9-a55f-c4a2420c877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:30.366065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4413c-53ff-43e9-a55f-c4a2420c877e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:30.366644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4413c-53ff-43e9-a55f-c4a2420c877e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:30.368703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4413c-53ff-43e9-a55f-c4a2420c877e admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:30.369650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4413c-53ff-43e9-a55f-c4a2420c877e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:30.376047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45404eb6-2600-4a76-b4bc-12a60b86c8b7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:30.387213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:30.388140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:30.388497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:30.388972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] PATH_INFO: `/v3/projects/ca74c3bb1ec141ff9b76dc5b29112b12` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:30.391373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca74c3bb1ec141ff9b76dc5b29112b12)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:30.433571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4413c-53ff-43e9-a55f-c4a2420c877e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:30.443906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:30.445166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 861/1708] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:30.448898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4413c-53ff-43e9-a55f-c4a2420c877e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:30.461011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4413c-53ff-43e9-a55f-c4a2420c877e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:30.467489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd83677-b6d0-46a1-b932-923dea45c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:30.468875 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd83677-b6d0-46a1-b932-923dea45c13f admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:30.469379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd83677-b6d0-46a1-b932-923dea45c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:30.469846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd83677-b6d0-46a1-b932-923dea45c13f admin admin] PATH_INFO: `/v3/projects/9fcb0e6492a14daab438b97b55ced825/users/57a4d11e3d0a4951a4e2244efed8ca5e/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:30.496799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd83677-b6d0-46a1-b932-923dea45c13f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fcb0e6492a14daab438b97b55ced825, user_id=57a4d11e3d0a4951a4e2244efed8ca5e, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:30.525744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd83677-b6d0-46a1-b932-923dea45c13f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:30.702288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 862/1709] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:30 2022] PUT /identity/v3/projects/9fcb0e6492a14daab438b97b55ced825/users/57a4d11e3d0a4951a4e2244efed8ca5e/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:30.714559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0163-3ba7-437c-a26d-1e31a7a428c3 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:30.715070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0163-3ba7-437c-a26d-1e31a7a428c3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:30.715642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c0163-3ba7-437c-a26d-1e31a7a428c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:30.733547 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca74c3bb1ec141ff9b76dc5b29112b12', 'request_id': 'req-7382a0cd-1090-42b7-8585-f6a83306f788'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:30.772748 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-de0c0163-3ba7-437c-a26d-1e31a7a428c3 None None] MFA Rules not processed for user `57a4d11e3d0a4951a4e2244efed8ca5e`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:30.773935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-de0c0163-3ba7-437c-a26d-1e31a7a428c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:30.861386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca74c3bb1ec141ff9b76dc5b29112b12', 'request_id': 'req-7382a0cd-1090-42b7-8585-f6a83306f788'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:30.872500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 863/1710] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:30 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:30.874482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca74c3bb1ec141ff9b76dc5b29112b12', 'request_id': 'req-7382a0cd-1090-42b7-8585-f6a83306f788'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:30.884944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c0163-3ba7-437c-a26d-1e31a7a428c3 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:30.889071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] The token cache is being invalidate because project ca74c3bb1ec141ff9b76dc5b29112b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:30.889363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:30.890198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:30.892954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 848/1711] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:30 2022] DELETE /identity/v3/projects/ca74c3bb1ec141ff9b76dc5b29112b12 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:30.898220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:30.899583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:30.997886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c0163-3ba7-437c-a26d-1e31a7a428c3 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:31.013026 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa695-0124-412d-ad8e-238d3000fc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:31.013687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa695-0124-412d-ad8e-238d3000fc3a admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:31.013981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa695-0124-412d-ad8e-238d3000fc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:31.016734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382a0cd-1090-42b7-8585-f6a83306f788 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:31.017380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55aa695-0124-412d-ad8e-238d3000fc3a admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:31.018238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aa695-0124-412d-ad8e-238d3000fc3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:31.038653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:31.039520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:31.039804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:31.040087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] PATH_INFO: `/v3/users/5a818c70d56446e490336fbbf93038a9` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:31.046673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a818c70d56446e490336fbbf93038a9)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:31.095278 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:31.124221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55aa695-0124-412d-ad8e-238d3000fc3a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:31.288975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 864/1712] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:30 2022] POST /identity/v3/projects => generated 371 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:31.290438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa695-0124-412d-ad8e-238d3000fc3a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:31.293088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a55aa695-0124-412d-ad8e-238d3000fc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:31.392365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55aa695-0124-412d-ad8e-238d3000fc3a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:31.408151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469766-5e03-4629-8aa4-1fcc11989d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:31.409786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469766-5e03-4629-8aa4-1fcc11989d5b admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:31.410613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469766-5e03-4629-8aa4-1fcc11989d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:31.412320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0469766-5e03-4629-8aa4-1fcc11989d5b admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:31.414491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0469766-5e03-4629-8aa4-1fcc11989d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:31.427671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a818c70d56446e490336fbbf93038a9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:31.444524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a818c70d56446e490336fbbf93038a9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:31.445681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a818c70d56446e490336fbbf93038a9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:31.457498 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a818c70d56446e490336fbbf93038a9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:31.473395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0469766-5e03-4629-8aa4-1fcc11989d5b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:31.626917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a818c70d56446e490336fbbf93038a9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:31.637775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 849/1713] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:30 2022] DELETE /identity/v3/users/5a818c70d56446e490336fbbf93038a9 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:31.639113 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:31.642043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:31.739092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 865/1714] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:31 2022] POST /identity/v3/users => generated 292 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:31.741338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469766-5e03-4629-8aa4-1fcc11989d5b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:31.745173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c0469766-5e03-4629-8aa4-1fcc11989d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:31.774967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0469766-5e03-4629-8aa4-1fcc11989d5b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:31.825271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779872c-9f89-4802-86bb-636cb213c70d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:31.835903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:31.836733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:31.837023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:31.837305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] PATH_INFO: `/v3/users/eae28220f96544d79d474b25aa2de55b` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:31.838586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae28220f96544d79d474b25aa2de55b)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:31.901720 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:32.062550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e839f-c6bb-4228-8909-5b56a8cf4bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:32.064167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e839f-c6bb-4228-8909-5b56a8cf4bfc admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:32.064592 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e839f-c6bb-4228-8909-5b56a8cf4bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:32.076511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e839f-c6bb-4228-8909-5b56a8cf4bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:32.077364 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e839f-c6bb-4228-8909-5b56a8cf4bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:32.125593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085e839f-c6bb-4228-8909-5b56a8cf4bfc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:32.169963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 866/1715] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:32.170897 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e839f-c6bb-4228-8909-5b56a8cf4bfc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:32.195984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085e839f-c6bb-4228-8909-5b56a8cf4bfc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:32.199225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfa78c-64bd-4666-b757-9a4f032e1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:32.200095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfa78c-64bd-4666-b757-9a4f032e1c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:32.200388 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfa78c-64bd-4666-b757-9a4f032e1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:32.200671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfa78c-64bd-4666-b757-9a4f032e1c7f admin admin] PATH_INFO: `/v3/projects/6578d133f29746c2ac66c8972010d615/users/2b9a2b832dd24cc3a2e6738355d4686e/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:32.243038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfa78c-64bd-4666-b757-9a4f032e1c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6578d133f29746c2ac66c8972010d615, user_id=2b9a2b832dd24cc3a2e6738355d4686e, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:32.294109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfa78c-64bd-4666-b757-9a4f032e1c7f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:32.404018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae28220f96544d79d474b25aa2de55b'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:32.428810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae28220f96544d79d474b25aa2de55b'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:32.428810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae28220f96544d79d474b25aa2de55b'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:32.437719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae28220f96544d79d474b25aa2de55b'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:32.462045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 867/1716] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:32 2022] PUT /identity/v3/projects/6578d133f29746c2ac66c8972010d615/users/2b9a2b832dd24cc3a2e6738355d4686e/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:32.466831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfa78c-64bd-4666-b757-9a4f032e1c7f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:32.575846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-016462f2-ca84-494d-8505-d4ba301fbe21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae28220f96544d79d474b25aa2de55b'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:32.586152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 850/1717] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:31 2022] DELETE /identity/v3/users/eae28220f96544d79d474b25aa2de55b => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:32.587812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d0641-75d9-4d81-afde-a7979765d272 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:32.588147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d0641-75d9-4d81-afde-a7979765d272 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:32.588426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfa78c-64bd-4666-b757-9a4f032e1c7f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:32.588542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d0641-75d9-4d81-afde-a7979765d272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:32.638169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-560d0641-75d9-4d81-afde-a7979765d272 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:32.639556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-560d0641-75d9-4d81-afde-a7979765d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:32.688149 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce63aa-8ef5-4087-b014-72413e5a292f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:32.689298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce63aa-8ef5-4087-b014-72413e5a292f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:32.689766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce63aa-8ef5-4087-b014-72413e5a292f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:32.690268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce63aa-8ef5-4087-b014-72413e5a292f admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:32.692089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce63aa-8ef5-4087-b014-72413e5a292f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:32.722888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce63aa-8ef5-4087-b014-72413e5a292f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:32.735272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 868/1718] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:32.740630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce63aa-8ef5-4087-b014-72413e5a292f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:32.746656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 851/1719] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:32.747123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d5ce63aa-8ef5-4087-b014-72413e5a292f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:32.755151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d0641-75d9-4d81-afde-a7979765d272 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:32.756660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-560d0641-75d9-4d81-afde-a7979765d272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:32.761982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce63aa-8ef5-4087-b014-72413e5a292f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:32.767138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1d06d-493c-40a6-bd48-669f79f52b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:32.768062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1d06d-493c-40a6-bd48-669f79f52b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:32.768414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1d06d-493c-40a6-bd48-669f79f52b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:32.768775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1d06d-493c-40a6-bd48-669f79f52b40 admin admin] PATH_INFO: `/v3/projects/6578d133f29746c2ac66c8972010d615/users/2b9a2b832dd24cc3a2e6738355d4686e/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:32.771016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1d06d-493c-40a6-bd48-669f79f52b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6578d133f29746c2ac66c8972010d615, user_id=2b9a2b832dd24cc3a2e6738355d4686e, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:32.802941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1d06d-493c-40a6-bd48-669f79f52b40 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:32.815346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 869/1720] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:32 2022] PUT /identity/v3/projects/6578d133f29746c2ac66c8972010d615/users/2b9a2b832dd24cc3a2e6738355d4686e/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:32.820425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1d06d-493c-40a6-bd48-669f79f52b40 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:32.906262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d0641-75d9-4d81-afde-a7979765d272 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:32.968236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1d06d-493c-40a6-bd48-669f79f52b40 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:32.970861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6c2ac-0e98-4e60-b352-07bdd90e9963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:32.971809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6c2ac-0e98-4e60-b352-07bdd90e9963 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:32.972203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6c2ac-0e98-4e60-b352-07bdd90e9963 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:32.973833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6c2ac-0e98-4e60-b352-07bdd90e9963 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:32.974676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6c2ac-0e98-4e60-b352-07bdd90e9963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:33.005590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25583521-c26d-4a95-b653-10a12fb65175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:33.007010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25583521-c26d-4a95-b653-10a12fb65175 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:33.007319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25583521-c26d-4a95-b653-10a12fb65175 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:33.007642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25583521-c26d-4a95-b653-10a12fb65175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:33.021062 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25583521-c26d-4a95-b653-10a12fb65175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:33.023617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6c2ac-0e98-4e60-b352-07bdd90e9963 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:33.036690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 870/1721] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:33.037967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6c2ac-0e98-4e60-b352-07bdd90e9963 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:33.045007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-18b6c2ac-0e98-4e60-b352-07bdd90e9963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:33.070047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6c2ac-0e98-4e60-b352-07bdd90e9963 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:33.084425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:33.085247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:33.085542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:33.085830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] PATH_INFO: `/v3/projects/9dfa35a6a97746fbac9279f5d5a4430c` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:33.088493 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dfa35a6a97746fbac9279f5d5a4430c)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:33.089200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25583521-c26d-4a95-b653-10a12fb65175 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:33.112881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 852/1722] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:10:33.114008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25583521-c26d-4a95-b653-10a12fb65175 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:33.126263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25583521-c26d-4a95-b653-10a12fb65175 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:33.137434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602b6bc-9776-4355-b807-48f8424f0b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:33.139059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602b6bc-9776-4355-b807-48f8424f0b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:33.139962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602b6bc-9776-4355-b807-48f8424f0b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:33.140475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602b6bc-9776-4355-b807-48f8424f0b0f admin admin] PATH_INFO: `/v3/projects/6578d133f29746c2ac66c8972010d615/users/2b9a2b832dd24cc3a2e6738355d4686e/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:33.142638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602b6bc-9776-4355-b807-48f8424f0b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6578d133f29746c2ac66c8972010d615, user_id=2b9a2b832dd24cc3a2e6738355d4686e, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:33.188150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602b6bc-9776-4355-b807-48f8424f0b0f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:33.188590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:33.341885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 853/1723] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:33 2022] PUT /identity/v3/projects/6578d133f29746c2ac66c8972010d615/users/2b9a2b832dd24cc3a2e6738355d4686e/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:33.346564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377a824-30e9-4a31-b6a0-12927123782e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:33.346865 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377a824-30e9-4a31-b6a0-12927123782e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:33.348520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377a824-30e9-4a31-b6a0-12927123782e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:33.461092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dfa35a6a97746fbac9279f5d5a4430c', 'request_id': 'req-437046b1-a2e6-4fcf-8038-86656387e41d'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:33.473746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-3377a824-30e9-4a31-b6a0-12927123782e None None] MFA Rules not processed for user `2b9a2b832dd24cc3a2e6738355d4686e`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:33.475913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-3377a824-30e9-4a31-b6a0-12927123782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:33.597099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dfa35a6a97746fbac9279f5d5a4430c', 'request_id': 'req-437046b1-a2e6-4fcf-8038-86656387e41d'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:33.619403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dfa35a6a97746fbac9279f5d5a4430c', 'request_id': 'req-437046b1-a2e6-4fcf-8038-86656387e41d'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:33.648517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] The token cache is being invalidate because project 9dfa35a6a97746fbac9279f5d5a4430c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:33.648815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:33.649439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:33.651061 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 854/1724] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:33 2022] POST /identity/v3/auth/tokens => generated 3745 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:33.656078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 871/1725] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:33 2022] DELETE /identity/v3/projects/9dfa35a6a97746fbac9279f5d5a4430c => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:33.662163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19875c18-9d3c-4880-b206-7d8eb455cf06 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:33.662163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19875c18-9d3c-4880-b206-7d8eb455cf06 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:33.662163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19875c18-9d3c-4880-b206-7d8eb455cf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:33.663237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:33.664916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:33.688623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-19875c18-9d3c-4880-b206-7d8eb455cf06 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:33.689922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-19875c18-9d3c-4880-b206-7d8eb455cf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:33.752322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437046b1-a2e6-4fcf-8038-86656387e41d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:33.756713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d4d46-3a65-4974-b8fb-0973d579e137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:33.757320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d4d46-3a65-4974-b8fb-0973d579e137 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:33.757615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d4d46-3a65-4974-b8fb-0973d579e137 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:33.758006 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d4d46-3a65-4974-b8fb-0973d579e137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:33.760834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-513d4d46-3a65-4974-b8fb-0973d579e137 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:33.786420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d4d46-3a65-4974-b8fb-0973d579e137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:33.826104 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d4d46-3a65-4974-b8fb-0973d579e137 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:33.839531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 872/1726] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:33 2022] GET /identity/v3/auth/tokens => generated 3745 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:33.870496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302afa0-8ffa-4aff-aa09-78bac1d0267b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:33.870863 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302afa0-8ffa-4aff-aa09-78bac1d0267b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:33.871142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302afa0-8ffa-4aff-aa09-78bac1d0267b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:33.875470 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 855/1727] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:33.914472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a302afa0-8ffa-4aff-aa09-78bac1d0267b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:33.914472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a302afa0-8ffa-4aff-aa09-78bac1d0267b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:33.926508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 873/1728] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:33.931219 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19875c18-9d3c-4880-b206-7d8eb455cf06 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:33.945387 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19875c18-9d3c-4880-b206-7d8eb455cf06 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:33.958442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1766-ca3d-4532-adaa-690ba842716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:33.959515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1766-ca3d-4532-adaa-690ba842716e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:33.960041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1766-ca3d-4532-adaa-690ba842716e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:33.960524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e1766-ca3d-4532-adaa-690ba842716e admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:33.961601 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1766-ca3d-4532-adaa-690ba842716e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:10:33.962223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1766-ca3d-4532-adaa-690ba842716e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:34.069752 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e1766-ca3d-4532-adaa-690ba842716e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:34.108175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 856/1729] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:10:34.109194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302afa0-8ffa-4aff-aa09-78bac1d0267b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:34.123811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302afa0-8ffa-4aff-aa09-78bac1d0267b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:34.165451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ad91-efce-4568-8790-69bb72422b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:34.166221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ad91-efce-4568-8790-69bb72422b30 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:34.166491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ad91-efce-4568-8790-69bb72422b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:34.166782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ad91-efce-4568-8790-69bb72422b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:34.179339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ad91-efce-4568-8790-69bb72422b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:34.297768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ad91-efce-4568-8790-69bb72422b30 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:34.435782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 874/1730] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:34 2022] POST /identity/v3/projects => generated 369 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:34.439826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1766-ca3d-4532-adaa-690ba842716e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:34.454442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e1766-ca3d-4532-adaa-690ba842716e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:34.633521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ad91-efce-4568-8790-69bb72422b30 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:34.635730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-9ec4ad91-efce-4568-8790-69bb72422b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:34.697592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a852a3-c416-43d6-a241-6415a4e8d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:34.698260 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a852a3-c416-43d6-a241-6415a4e8d560 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:34.698502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a852a3-c416-43d6-a241-6415a4e8d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:34.698786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a852a3-c416-43d6-a241-6415a4e8d560 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:34.699483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a852a3-c416-43d6-a241-6415a4e8d560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:34.833689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a852a3-c416-43d6-a241-6415a4e8d560 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:34.881582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ad91-efce-4568-8790-69bb72422b30 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:34.887342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:34.888425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:34.888784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:34.889179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] PATH_INFO: `/v3/projects/f662962148f44137ab868b4fcb2a874d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:34.900150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f662962148f44137ab868b4fcb2a874d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:34.960818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:35.052066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 857/1731] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:34 2022] POST /identity/v3/users => generated 285 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:35.055220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a852a3-c416-43d6-a241-6415a4e8d560 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:35.083480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a852a3-c416-43d6-a241-6415a4e8d560 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:35.094590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5e90a-6196-4d6b-8daf-d5e89e1e4113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:35.094590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5e90a-6196-4d6b-8daf-d5e89e1e4113 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:35.094590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5e90a-6196-4d6b-8daf-d5e89e1e4113 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:35.094590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5e90a-6196-4d6b-8daf-d5e89e1e4113 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:35.094910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5e90a-6196-4d6b-8daf-d5e89e1e4113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:35.153225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5e90a-6196-4d6b-8daf-d5e89e1e4113 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:35.185652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 858/1732] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:35.187230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5e90a-6196-4d6b-8daf-d5e89e1e4113 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:35.197830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f662962148f44137ab868b4fcb2a874d', 'request_id': 'req-6395768e-647a-4d60-bd5d-74bebe818fac'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:35.205922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5e90a-6196-4d6b-8daf-d5e89e1e4113 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:35.296629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3cca4-f9f0-48d2-9096-10adb0eed2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:35.297978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3cca4-f9f0-48d2-9096-10adb0eed2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:35.297978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3cca4-f9f0-48d2-9096-10adb0eed2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:35.298195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3cca4-f9f0-48d2-9096-10adb0eed2d3 admin admin] PATH_INFO: `/v3/projects/5e75706e93ae42d2a340fb1bea72c9f8/users/00a3f23cd76745fdbf1b7fc1a875cb92/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:35.320210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3cca4-f9f0-48d2-9096-10adb0eed2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e75706e93ae42d2a340fb1bea72c9f8, user_id=00a3f23cd76745fdbf1b7fc1a875cb92, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:35.335611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f662962148f44137ab868b4fcb2a874d', 'request_id': 'req-6395768e-647a-4d60-bd5d-74bebe818fac'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:35.355768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f662962148f44137ab868b4fcb2a874d', 'request_id': 'req-6395768e-647a-4d60-bd5d-74bebe818fac'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:35.369787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3cca4-f9f0-48d2-9096-10adb0eed2d3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:35.374686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] The token cache is being invalidate because project f662962148f44137ab868b4fcb2a874d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:35.374686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:35.388161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:35.392447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 875/1733] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:34 2022] DELETE /identity/v3/projects/f662962148f44137ab868b4fcb2a874d => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:35.397269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:35.398628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:35.413832 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395768e-647a-4d60-bd5d-74bebe818fac admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:35.418670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:35.419580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:35.419879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:35.420167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] PATH_INFO: `/v3/users/2ec3ce14e84b4a2e9b473c2f5954bdf8` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:35.421421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec3ce14e84b4a2e9b473c2f5954bdf8)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:35.449205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:35.530194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 859/1734] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:35 2022] PUT /identity/v3/projects/5e75706e93ae42d2a340fb1bea72c9f8/users/00a3f23cd76745fdbf1b7fc1a875cb92/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:35.531290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3cca4-f9f0-48d2-9096-10adb0eed2d3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:35.535998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-eac3cca4-f9f0-48d2-9096-10adb0eed2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:35.672226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3cca4-f9f0-48d2-9096-10adb0eed2d3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:35.680722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:35.681739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:35.682123 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:35.682502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] PATH_INFO: `/v3/users/57a4d11e3d0a4951a4e2244efed8ca5e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:35.684050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a4d11e3d0a4951a4e2244efed8ca5e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:35.725322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:35.794624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec3ce14e84b4a2e9b473c2f5954bdf8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:35.795740 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec3ce14e84b4a2e9b473c2f5954bdf8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:35.809471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec3ce14e84b4a2e9b473c2f5954bdf8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:35.842981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec3ce14e84b4a2e9b473c2f5954bdf8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:36.005604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-91356ad7-7fd3-4345-9408-29bac274ada0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec3ce14e84b4a2e9b473c2f5954bdf8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:36.022688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 876/1735] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:35 2022] DELETE /identity/v3/users/2ec3ce14e84b4a2e9b473c2f5954bdf8 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:36.022688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408b400-84cf-41c3-bd9c-51a2b98cfe94 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:36.022688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408b400-84cf-41c3-bd9c-51a2b98cfe94 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:36.022688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408b400-84cf-41c3-bd9c-51a2b98cfe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:36.101533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a4d11e3d0a4951a4e2244efed8ca5e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:36.135885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a408b400-84cf-41c3-bd9c-51a2b98cfe94 None None] MFA Rules not processed for user `00a3f23cd76745fdbf1b7fc1a875cb92`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:36.137291 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a408b400-84cf-41c3-bd9c-51a2b98cfe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:36.143386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a4d11e3d0a4951a4e2244efed8ca5e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:36.145329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a4d11e3d0a4951a4e2244efed8ca5e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:36.170740 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a4d11e3d0a4951a4e2244efed8ca5e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:36.293169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 877/1736] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:36 2022] POST /identity/v3/auth/tokens => generated 3676 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:36.297255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-80805729-5f9b-488c-89aa-cdd33a4ce45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a4d11e3d0a4951a4e2244efed8ca5e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:36.302358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408b400-84cf-41c3-bd9c-51a2b98cfe94 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:36.302358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a408b400-84cf-41c3-bd9c-51a2b98cfe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:36.310974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 860/1737] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:35 2022] DELETE /identity/v3/users/57a4d11e3d0a4951a4e2244efed8ca5e => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:36.314429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a046-4448-44f0-8cdb-4a59c266c60b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:36.314947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a046-4448-44f0-8cdb-4a59c266c60b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:36.316453 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a046-4448-44f0-8cdb-4a59c266c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:36.368452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-bce2a046-4448-44f0-8cdb-4a59c266c60b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:36.369878 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bce2a046-4448-44f0-8cdb-4a59c266c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:36.439283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408b400-84cf-41c3-bd9c-51a2b98cfe94 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:36.476558 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 861/1738] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:36.491919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a046-4448-44f0-8cdb-4a59c266c60b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:36.493566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bce2a046-4448-44f0-8cdb-4a59c266c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:36.588051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a046-4448-44f0-8cdb-4a59c266c60b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:36.592893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55188a2-cd3a-4f61-953b-28bf39edd0c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:36.593575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55188a2-cd3a-4f61-953b-28bf39edd0c5 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:36.593955 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55188a2-cd3a-4f61-953b-28bf39edd0c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:36.594303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55188a2-cd3a-4f61-953b-28bf39edd0c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:36.607897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55188a2-cd3a-4f61-953b-28bf39edd0c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:36.631917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90a4b9-d0bc-4c93-8878-84849f8f578d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:36.632823 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90a4b9-d0bc-4c93-8878-84849f8f578d admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:36.633284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90a4b9-d0bc-4c93-8878-84849f8f578d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:36.633779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90a4b9-d0bc-4c93-8878-84849f8f578d admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:36.634586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90a4b9-d0bc-4c93-8878-84849f8f578d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:36.642469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55188a2-cd3a-4f61-953b-28bf39edd0c5 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:36.659042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 862/1739] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:36.667845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90a4b9-d0bc-4c93-8878-84849f8f578d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:36.914634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55188a2-cd3a-4f61-953b-28bf39edd0c5 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:36.916026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f55188a2-cd3a-4f61-953b-28bf39edd0c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:36.922554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 878/1740] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:36 2022] POST /identity/v3/projects => generated 369 bytes in 625 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:36.933774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55188a2-cd3a-4f61-953b-28bf39edd0c5 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:37.020485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455ce4-3871-484f-b20a-a2e1ecc7d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:37.021183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455ce4-3871-484f-b20a-a2e1ecc7d8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.021596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455ce4-3871-484f-b20a-a2e1ecc7d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.021956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455ce4-3871-484f-b20a-a2e1ecc7d8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.022980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455ce4-3871-484f-b20a-a2e1ecc7d8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:37.027611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90a4b9-d0bc-4c93-8878-84849f8f578d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:37.030039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cb90a4b9-d0bc-4c93-8878-84849f8f578d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:37.044633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90a4b9-d0bc-4c93-8878-84849f8f578d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:37.049560 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:37.050726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.051653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.052206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] PATH_INFO: `/v3/projects/db8eb6021cc54c318a955c139b419e20` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.053580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8eb6021cc54c318a955c139b419e20)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:37.072925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455ce4-3871-484f-b20a-a2e1ecc7d8b5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:37.079789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:37.190434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 863/1741] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:36 2022] POST /identity/v3/users => generated 291 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:37.195082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455ce4-3871-484f-b20a-a2e1ecc7d8b5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:37.204868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455ce4-3871-484f-b20a-a2e1ecc7d8b5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:37.209680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a165d4-a44d-4301-940f-c2a824a3208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:37.210363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a165d4-a44d-4301-940f-c2a824a3208b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.210721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a165d4-a44d-4301-940f-c2a824a3208b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.211070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a165d4-a44d-4301-940f-c2a824a3208b admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.211874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a165d4-a44d-4301-940f-c2a824a3208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:37.238497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a165d4-a44d-4301-940f-c2a824a3208b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:37.250357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 864/1742] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:10:37.261336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a165d4-a44d-4301-940f-c2a824a3208b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:37.264422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8eb6021cc54c318a955c139b419e20', 'request_id': 'req-80d91179-79b9-4d49-9f75-c0ed22bc23b7'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:37.271626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a165d4-a44d-4301-940f-c2a824a3208b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:37.342085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3355b-fa0f-499f-b063-c781b0cd6cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:37.342833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3355b-fa0f-499f-b063-c781b0cd6cce admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.343112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3355b-fa0f-499f-b063-c781b0cd6cce admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.343421 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3355b-fa0f-499f-b063-c781b0cd6cce admin admin] PATH_INFO: `/v3/projects/64bca8800cbb455db3dc6f537fa45666/users/1072607a3ab042ad808e9f24cdd03d68/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.364229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3355b-fa0f-499f-b063-c781b0cd6cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=64bca8800cbb455db3dc6f537fa45666, user_id=1072607a3ab042ad808e9f24cdd03d68, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:37.391129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3355b-fa0f-499f-b063-c781b0cd6cce admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:37.411041 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8eb6021cc54c318a955c139b419e20', 'request_id': 'req-80d91179-79b9-4d49-9f75-c0ed22bc23b7'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:37.423251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8eb6021cc54c318a955c139b419e20', 'request_id': 'req-80d91179-79b9-4d49-9f75-c0ed22bc23b7'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:37.435432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] The token cache is being invalidate because project db8eb6021cc54c318a955c139b419e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:37.435726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:37.436362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-80d91179-79b9-4d49-9f75-c0ed22bc23b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:37.439539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 879/1743] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:37 2022] DELETE /identity/v3/projects/db8eb6021cc54c318a955c139b419e20 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:37.444133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b1187-7f07-45b0-a8d2-976592b80bef None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.444432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b1187-7f07-45b0-a8d2-976592b80bef None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.445275 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b1187-7f07-45b0-a8d2-976592b80bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.474091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-cf6b1187-7f07-45b0-a8d2-976592b80bef None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:37.475280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cf6b1187-7f07-45b0-a8d2-976592b80bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:37.493665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 880/1744] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:37.495108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c09e64-401d-4397-997c-dad1ffec4aef None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.495444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c09e64-401d-4397-997c-dad1ffec4aef None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.495737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c09e64-401d-4397-997c-dad1ffec4aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.526185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c2c09e64-401d-4397-997c-dad1ffec4aef None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:37.527398 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c2c09e64-401d-4397-997c-dad1ffec4aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:37.535691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 881/1745] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:37.539456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c09e64-401d-4397-997c-dad1ffec4aef None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:37.548804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c09e64-401d-4397-997c-dad1ffec4aef None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:37.554776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a22cb-f5f6-4a96-b424-15fc5ba24418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:37.555429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a22cb-f5f6-4a96-b424-15fc5ba24418 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.555723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a22cb-f5f6-4a96-b424-15fc5ba24418 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.556008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a22cb-f5f6-4a96-b424-15fc5ba24418 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.556826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a22cb-f5f6-4a96-b424-15fc5ba24418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:10:37.557129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a22cb-f5f6-4a96-b424-15fc5ba24418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:37.570884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 865/1746] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:37 2022] PUT /identity/v3/projects/64bca8800cbb455db3dc6f537fa45666/users/1072607a3ab042ad808e9f24cdd03d68/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:37.584876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3355b-fa0f-499f-b063-c781b0cd6cce admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:37.586547 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b4e3355b-fa0f-499f-b063-c781b0cd6cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:37.588273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a22cb-f5f6-4a96-b424-15fc5ba24418 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:37.636196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 882/1747] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:10:37.637172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a22cb-f5f6-4a96-b424-15fc5ba24418 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:37.653993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a22cb-f5f6-4a96-b424-15fc5ba24418 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:37.710921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3355b-fa0f-499f-b063-c781b0cd6cce admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:37.717551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861aaf71-e2ed-42e5-8422-8688505876b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:37.718029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861aaf71-e2ed-42e5-8422-8688505876b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.718316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861aaf71-e2ed-42e5-8422-8688505876b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.719018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861aaf71-e2ed-42e5-8422-8688505876b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.719753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861aaf71-e2ed-42e5-8422-8688505876b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:37.751425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861aaf71-e2ed-42e5-8422-8688505876b1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:37.767736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 866/1748] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:10:37.768674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861aaf71-e2ed-42e5-8422-8688505876b1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:37.770766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-861aaf71-e2ed-42e5-8422-8688505876b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:37.789649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa97d95-9ae1-4e0e-9d16-982271572c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:37.790255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa97d95-9ae1-4e0e-9d16-982271572c61 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.791167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa97d95-9ae1-4e0e-9d16-982271572c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.791519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa97d95-9ae1-4e0e-9d16-982271572c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.792170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa97d95-9ae1-4e0e-9d16-982271572c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:37.792455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861aaf71-e2ed-42e5-8422-8688505876b1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:37.798171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:37.798975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:37.799265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:37.804251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] PATH_INFO: `/v3/projects/9fcb0e6492a14daab438b97b55ced825` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:37.804251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fcb0e6492a14daab438b97b55ced825)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:37.821719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa97d95-9ae1-4e0e-9d16-982271572c61 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:37.862196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:37.952866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 883/1749] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:37 2022] POST /identity/v3/projects => generated 363 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:37.952866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa97d95-9ae1-4e0e-9d16-982271572c61 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:38.022177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa97d95-9ae1-4e0e-9d16-982271572c61 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:38.027353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56908c78-3db1-4ff3-82a3-f86e590c213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:38.028173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908c78-3db1-4ff3-82a3-f86e590c213b admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:38.028460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908c78-3db1-4ff3-82a3-f86e590c213b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:38.028737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908c78-3db1-4ff3-82a3-f86e590c213b admin admin] PATH_INFO: `/v3/projects/64bca8800cbb455db3dc6f537fa45666/users/1072607a3ab042ad808e9f24cdd03d68/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:38.031017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56908c78-3db1-4ff3-82a3-f86e590c213b admin admin] RBAC: Authorizing `identity:create_grant(project_id=64bca8800cbb455db3dc6f537fa45666, user_id=1072607a3ab042ad808e9f24cdd03d68, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:38.040859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fcb0e6492a14daab438b97b55ced825', 'request_id': 'req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.059083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56908c78-3db1-4ff3-82a3-f86e590c213b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:38.073219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 884/1750] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:37 2022] PUT /identity/v3/projects/64bca8800cbb455db3dc6f537fa45666/users/1072607a3ab042ad808e9f24cdd03d68/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:38.073219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56908c78-3db1-4ff3-82a3-f86e590c213b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:38.142162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fcb0e6492a14daab438b97b55ced825', 'request_id': 'req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.143273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56908c78-3db1-4ff3-82a3-f86e590c213b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:38.148961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917d84b-8599-4828-ab6c-d318de35b164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:38.149977 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917d84b-8599-4828-ab6c-d318de35b164 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:38.150111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917d84b-8599-4828-ab6c-d318de35b164 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:38.150471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917d84b-8599-4828-ab6c-d318de35b164 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:38.151502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917d84b-8599-4828-ab6c-d318de35b164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:38.155357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fcb0e6492a14daab438b97b55ced825', 'request_id': 'req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.167473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] The token cache is being invalidate because project 9fcb0e6492a14daab438b97b55ced825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:38.167757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.168624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.173044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 867/1751] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:37 2022] DELETE /identity/v3/projects/9fcb0e6492a14daab438b97b55ced825 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:38.176011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:38.176011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:38.180097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917d84b-8599-4828-ab6c-d318de35b164 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:38.245405 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd77f77f-03d5-4be2-a3ac-38fe7bc8005a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:38.249782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac09488-77e3-4ca3-b225-28ad475880fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:38.250385 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac09488-77e3-4ca3-b225-28ad475880fd admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:38.250672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac09488-77e3-4ca3-b225-28ad475880fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:38.250952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac09488-77e3-4ca3-b225-28ad475880fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:38.251688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac09488-77e3-4ca3-b225-28ad475880fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:38.278253 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac09488-77e3-4ca3-b225-28ad475880fd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:38.292510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 868/1752] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:38.292510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac09488-77e3-4ca3-b225-28ad475880fd admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:38.294371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6ac09488-77e3-4ca3-b225-28ad475880fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:38.320914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac09488-77e3-4ca3-b225-28ad475880fd admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:38.324071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 885/1753] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:38 2022] POST /identity/v3/users => generated 282 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:38.324071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917d84b-8599-4828-ab6c-d318de35b164 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:38.334735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:38.336028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:38.336028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:38.336422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] PATH_INFO: `/v3/users/2b9a2b832dd24cc3a2e6738355d4686e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:38.337845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b9a2b832dd24cc3a2e6738355d4686e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:38.345461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917d84b-8599-4828-ab6c-d318de35b164 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:38.350712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5e27-e426-4914-ab75-a16a54188bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:38.352341 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5e27-e426-4914-ab75-a16a54188bd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:38.352633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5e27-e426-4914-ab75-a16a54188bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:38.352924 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a5e27-e426-4914-ab75-a16a54188bd5 admin admin] PATH_INFO: `/v3/projects/64bca8800cbb455db3dc6f537fa45666/users/1072607a3ab042ad808e9f24cdd03d68/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:38.355183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5e27-e426-4914-ab75-a16a54188bd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64bca8800cbb455db3dc6f537fa45666, user_id=1072607a3ab042ad808e9f24cdd03d68, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:38.389804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:38.401068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a5e27-e426-4914-ab75-a16a54188bd5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:38.582750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 886/1754] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:38 2022] PUT /identity/v3/projects/64bca8800cbb455db3dc6f537fa45666/users/1072607a3ab042ad808e9f24cdd03d68/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:38.584027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5e27-e426-4914-ab75-a16a54188bd5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:38.585338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ad1a5e27-e426-4914-ab75-a16a54188bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:38.656299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a5e27-e426-4914-ab75-a16a54188bd5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:38.660618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1208fab-a746-4260-821e-dc2636481de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:38.661212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1208fab-a746-4260-821e-dc2636481de1 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:38.661501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1208fab-a746-4260-821e-dc2636481de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:38.661780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1208fab-a746-4260-821e-dc2636481de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:38.662471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1208fab-a746-4260-821e-dc2636481de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:38.688966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1208fab-a746-4260-821e-dc2636481de1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:38.702216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 887/1755] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:38.703517 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981b794-040b-41ef-8501-9e3f92661481 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:38.703805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981b794-040b-41ef-8501-9e3f92661481 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:38.704085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981b794-040b-41ef-8501-9e3f92661481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:38.753408 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b9a2b832dd24cc3a2e6738355d4686e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.759628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-0981b794-040b-41ef-8501-9e3f92661481 None None] MFA Rules not processed for user `1072607a3ab042ad808e9f24cdd03d68`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:38.760853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0981b794-040b-41ef-8501-9e3f92661481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:38.768534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b9a2b832dd24cc3a2e6738355d4686e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.769990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b9a2b832dd24cc3a2e6738355d4686e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.778827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b9a2b832dd24cc3a2e6738355d4686e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.844418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 888/1756] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:38 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:38.845308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981b794-040b-41ef-8501-9e3f92661481 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:38.854656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981b794-040b-41ef-8501-9e3f92661481 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:38.858874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7db1e-5fe9-4fdc-a1aa-00701e11afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:38.859722 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7db1e-5fe9-4fdc-a1aa-00701e11afc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:38.860070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7db1e-5fe9-4fdc-a1aa-00701e11afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:38.860284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7db1e-5fe9-4fdc-a1aa-00701e11afc2 admin admin] PATH_INFO: `/v3/projects/e63320e5c36044b9822c660674da35af/users/b8afc7b976604337a4117a540c695621/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:38.882145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7db1e-5fe9-4fdc-a1aa-00701e11afc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63320e5c36044b9822c660674da35af, user_id=b8afc7b976604337a4117a540c695621, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:38.901477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b9a2b832dd24cc3a2e6738355d4686e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:38.908690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 869/1757] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:38 2022] DELETE /identity/v3/users/2b9a2b832dd24cc3a2e6738355d4686e => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:38.908921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7db1e-5fe9-4fdc-a1aa-00701e11afc2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:38.909202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:38.910787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:38.985335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d6b6fb-697a-4fde-9688-32d8515f7b4b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:38.990313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:38.990916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:38.991214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:38.991559 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:38.993970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:39.023566 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 889/1758] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:38 2022] PUT /identity/v3/projects/e63320e5c36044b9822c660674da35af/users/b8afc7b976604337a4117a540c695621/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:39.037746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd2fe1-b034-4920-8f39-1fbe15721097 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:39.037746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd2fe1-b034-4920-8f39-1fbe15721097 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:39.037746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd2fe1-b034-4920-8f39-1fbe15721097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:39.086285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:39.120503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c4fd2fe1-b034-4920-8f39-1fbe15721097 None None] MFA Rules not processed for user `b8afc7b976604337a4117a540c695621`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:39.121921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:39.122489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c4fd2fe1-b034-4920-8f39-1fbe15721097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:39.136839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 870/1759] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:38 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:39.240744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 890/1760] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:39 2022] POST /identity/v3/auth/tokens => generated 3670 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:39.245179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:39.246605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:39.341272 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe474c-be03-418f-acc0-fd4d69066646 service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:39.432493 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1784-1127-420a-8d18-c0c4a7c8dbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:39.433105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1784-1127-420a-8d18-c0c4a7c8dbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:39.433917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1784-1127-420a-8d18-c0c4a7c8dbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:39.434216 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf1784-1127-420a-8d18-c0c4a7c8dbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:39.434972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf1784-1127-420a-8d18-c0c4a7c8dbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:39.470690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf1784-1127-420a-8d18-c0c4a7c8dbc4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:39.622964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd2fe1-b034-4920-8f39-1fbe15721097 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:39.628076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c4fd2fe1-b034-4920-8f39-1fbe15721097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:39.635383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 871/1761] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:39 2022] POST /identity/v3/projects => generated 365 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:39.639775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1784-1127-420a-8d18-c0c4a7c8dbc4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:39.653076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd2fe1-b034-4920-8f39-1fbe15721097 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:39.729069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf1784-1127-420a-8d18-c0c4a7c8dbc4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:39.736351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12671b54-a923-4342-865d-654e83468166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:39.737524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12671b54-a923-4342-865d-654e83468166 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:39.739185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12671b54-a923-4342-865d-654e83468166 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:39.739743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12671b54-a923-4342-865d-654e83468166 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:39.740791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12671b54-a923-4342-865d-654e83468166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:39.751175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:39.752178 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:39.752473 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:39.752770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] PATH_INFO: `/v3/projects/6578d133f29746c2ac66c8972010d615` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:39.754519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6578d133f29746c2ac66c8972010d615)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:39.773428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12671b54-a923-4342-865d-654e83468166 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:39.780926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:39.930446 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 872/1762] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:39 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:10:39.935382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12671b54-a923-4342-865d-654e83468166 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:39.946098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12671b54-a923-4342-865d-654e83468166 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:39.950298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76de9-1bbd-493a-9ee1-ae6481103dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:39.951022 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76de9-1bbd-493a-9ee1-ae6481103dbc admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:39.951504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76de9-1bbd-493a-9ee1-ae6481103dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:39.951701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a76de9-1bbd-493a-9ee1-ae6481103dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:39.952482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a76de9-1bbd-493a-9ee1-ae6481103dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:39.979911 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a76de9-1bbd-493a-9ee1-ae6481103dbc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:39.992142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 873/1763] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:10:39.996404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76de9-1bbd-493a-9ee1-ae6481103dbc admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.000617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6578d133f29746c2ac66c8972010d615', 'request_id': 'req-9ba93860-a707-40cd-b6cb-a90a809355e9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:40.006452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a76de9-1bbd-493a-9ee1-ae6481103dbc admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.076859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ae48b-2085-4b4c-9cff-be4f215bdd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:40.077823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae48b-2085-4b4c-9cff-be4f215bdd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.078211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae48b-2085-4b4c-9cff-be4f215bdd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.078544 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ae48b-2085-4b4c-9cff-be4f215bdd5d admin admin] PATH_INFO: `/v3/projects/a16e88d6abd240d1ab3b76f77f8ecafe/users/45d3554650dd45089adb8918018b4022/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.102519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ae48b-2085-4b4c-9cff-be4f215bdd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16e88d6abd240d1ab3b76f77f8ecafe, user_id=45d3554650dd45089adb8918018b4022, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:40.106703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6578d133f29746c2ac66c8972010d615', 'request_id': 'req-9ba93860-a707-40cd-b6cb-a90a809355e9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:40.120556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6578d133f29746c2ac66c8972010d615', 'request_id': 'req-9ba93860-a707-40cd-b6cb-a90a809355e9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:40.129293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ae48b-2085-4b4c-9cff-be4f215bdd5d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:40.132104 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] The token cache is being invalidate because project 6578d133f29746c2ac66c8972010d615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:40.132393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:40.133057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ba93860-a707-40cd-b6cb-a90a809355e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:40.134502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 891/1764] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:39 2022] DELETE /identity/v3/projects/6578d133f29746c2ac66c8972010d615 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:40.140176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164c0f0-8ec3-4a9b-8404-060b0bb587da None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.140469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164c0f0-8ec3-4a9b-8404-060b0bb587da None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.140780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164c0f0-8ec3-4a9b-8404-060b0bb587da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.164149 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5164c0f0-8ec3-4a9b-8404-060b0bb587da None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:40.165362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5164c0f0-8ec3-4a9b-8404-060b0bb587da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:40.172415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 892/1765] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:40.181333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67087b3c-8e4e-4e5f-8afc-5b8d2b355153 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.181626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67087b3c-8e4e-4e5f-8afc-5b8d2b355153 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.181913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67087b3c-8e4e-4e5f-8afc-5b8d2b355153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.204979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-67087b3c-8e4e-4e5f-8afc-5b8d2b355153 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:40.206120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-67087b3c-8e4e-4e5f-8afc-5b8d2b355153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:40.222454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 893/1766] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:40.229790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67087b3c-8e4e-4e5f-8afc-5b8d2b355153 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.241261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67087b3c-8e4e-4e5f-8afc-5b8d2b355153 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.245629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fa25a-242a-42b6-9724-e3eeeff5baf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:40.246214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fa25a-242a-42b6-9724-e3eeeff5baf0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.246505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fa25a-242a-42b6-9724-e3eeeff5baf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.246789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8fa25a-242a-42b6-9724-e3eeeff5baf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.247519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fa25a-242a-42b6-9724-e3eeeff5baf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:10:40.247842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fa25a-242a-42b6-9724-e3eeeff5baf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:40.274443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8fa25a-242a-42b6-9724-e3eeeff5baf0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:40.283122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 874/1767] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:39 2022] PUT /identity/v3/projects/a16e88d6abd240d1ab3b76f77f8ecafe/users/45d3554650dd45089adb8918018b4022/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:40.287533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ae48b-2085-4b4c-9cff-be4f215bdd5d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.290595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4b1ae48b-2085-4b4c-9cff-be4f215bdd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:40.292842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 894/1768] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:10:40.297171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fa25a-242a-42b6-9724-e3eeeff5baf0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.308764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8fa25a-242a-42b6-9724-e3eeeff5baf0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.383533 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cdb12-1c41-4e89-9cac-d7860c7c36f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:40.384135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cdb12-1c41-4e89-9cac-d7860c7c36f4 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.384424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cdb12-1c41-4e89-9cac-d7860c7c36f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.384708 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cdb12-1c41-4e89-9cac-d7860c7c36f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.385355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cdb12-1c41-4e89-9cac-d7860c7c36f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:40.387443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ae48b-2085-4b4c-9cff-be4f215bdd5d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.392437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b52303-1f90-4a63-9604-e2ffc9376de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:40.393106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b52303-1f90-4a63-9604-e2ffc9376de2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.393394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b52303-1f90-4a63-9604-e2ffc9376de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.393662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b52303-1f90-4a63-9604-e2ffc9376de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.395513 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b52303-1f90-4a63-9604-e2ffc9376de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:40.412975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cdb12-1c41-4e89-9cac-d7860c7c36f4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:40.432322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b52303-1f90-4a63-9604-e2ffc9376de2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:40.451909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 875/1769] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:10:40.456363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b52303-1f90-4a63-9604-e2ffc9376de2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.471780 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b52303-1f90-4a63-9604-e2ffc9376de2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.477443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99ca3c-e60c-4793-9b55-5fb7af0b99c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:40.483637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ca3c-e60c-4793-9b55-5fb7af0b99c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.484094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ca3c-e60c-4793-9b55-5fb7af0b99c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.484681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99ca3c-e60c-4793-9b55-5fb7af0b99c7 admin admin] PATH_INFO: `/v3/projects/a16e88d6abd240d1ab3b76f77f8ecafe/users/45d3554650dd45089adb8918018b4022/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.486913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99ca3c-e60c-4793-9b55-5fb7af0b99c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16e88d6abd240d1ab3b76f77f8ecafe, user_id=45d3554650dd45089adb8918018b4022, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:40.518023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99ca3c-e60c-4793-9b55-5fb7af0b99c7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:40.530882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 876/1770] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:40 2022] PUT /identity/v3/projects/a16e88d6abd240d1ab3b76f77f8ecafe/users/45d3554650dd45089adb8918018b4022/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:40.535866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99ca3c-e60c-4793-9b55-5fb7af0b99c7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.595851 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 895/1771] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:40 2022] POST /identity/v3/projects => generated 365 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:10:40.599670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cdb12-1c41-4e89-9cac-d7860c7c36f4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.651065 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99ca3c-e60c-4793-9b55-5fb7af0b99c7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.709072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cdb12-1c41-4e89-9cac-d7860c7c36f4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.716153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a79c8a-a849-4218-a7cb-79edf41bf8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:40.717403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a79c8a-a849-4218-a7cb-79edf41bf8ab admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.717877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a79c8a-a849-4218-a7cb-79edf41bf8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.718338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a79c8a-a849-4218-a7cb-79edf41bf8ab admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.719452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a79c8a-a849-4218-a7cb-79edf41bf8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:40.729528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ebb57-66af-400c-b2d2-5662eb2800d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:40.730187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ebb57-66af-400c-b2d2-5662eb2800d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.730464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ebb57-66af-400c-b2d2-5662eb2800d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.730897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ebb57-66af-400c-b2d2-5662eb2800d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.731632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ebb57-66af-400c-b2d2-5662eb2800d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:40.758770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ebb57-66af-400c-b2d2-5662eb2800d0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:40.759914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a79c8a-a849-4218-a7cb-79edf41bf8ab admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:40.770463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 877/1772] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:10:40.774919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ebb57-66af-400c-b2d2-5662eb2800d0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.785135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ebb57-66af-400c-b2d2-5662eb2800d0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.789621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2cbdc-d145-4caa-85bf-233468d2f545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:40.790412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2cbdc-d145-4caa-85bf-233468d2f545 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.790698 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2cbdc-d145-4caa-85bf-233468d2f545 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.790976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2cbdc-d145-4caa-85bf-233468d2f545 admin admin] PATH_INFO: `/v3/projects/a16e88d6abd240d1ab3b76f77f8ecafe/users/45d3554650dd45089adb8918018b4022/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.792821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2cbdc-d145-4caa-85bf-233468d2f545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16e88d6abd240d1ab3b76f77f8ecafe, user_id=45d3554650dd45089adb8918018b4022, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:40.820311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2cbdc-d145-4caa-85bf-233468d2f545 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:40.906083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 896/1773] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:40 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:40.907239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a79c8a-a849-4218-a7cb-79edf41bf8ab admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.917085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a79c8a-a849-4218-a7cb-79edf41bf8ab admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.921368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19314-7907-40dc-97db-d7ef53be85b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:40.921954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19314-7907-40dc-97db-d7ef53be85b3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.922250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19314-7907-40dc-97db-d7ef53be85b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.922639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19314-7907-40dc-97db-d7ef53be85b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:40.923221 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f19314-7907-40dc-97db-d7ef53be85b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:40.950941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f19314-7907-40dc-97db-d7ef53be85b3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:40.962386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 897/1774] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:40.966662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19314-7907-40dc-97db-d7ef53be85b3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:40.977430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19314-7907-40dc-97db-d7ef53be85b3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:40.977613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 878/1775] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:40 2022] PUT /identity/v3/projects/a16e88d6abd240d1ab3b76f77f8ecafe/users/45d3554650dd45089adb8918018b4022/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:40.988190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df5532-e8c9-4f1c-bb27-77fc35e813c5 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:40.989683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df5532-e8c9-4f1c-bb27-77fc35e813c5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:40.989683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df5532-e8c9-4f1c-bb27-77fc35e813c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:41.031285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c1df5532-e8c9-4f1c-bb27-77fc35e813c5 None None] MFA Rules not processed for user `45d3554650dd45089adb8918018b4022`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:41.032535 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c1df5532-e8c9-4f1c-bb27-77fc35e813c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:41.061769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb3599-8a55-461b-b45d-484069c0eb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:41.063074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb3599-8a55-461b-b45d-484069c0eb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:41.063633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb3599-8a55-461b-b45d-484069c0eb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:41.064079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb3599-8a55-461b-b45d-484069c0eb27 admin admin] PATH_INFO: `/v3/projects/23b0b36d16724a9d880fc8366e9b855d/users/0f8981b4c9d7459b8981c4b8d61670bf/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:41.088444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb3599-8a55-461b-b45d-484069c0eb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b0b36d16724a9d880fc8366e9b855d, user_id=0f8981b4c9d7459b8981c4b8d61670bf, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:41.126638 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb3599-8a55-461b-b45d-484069c0eb27 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:41.134629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 879/1776] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:40 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:41.144957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df5532-e8c9-4f1c-bb27-77fc35e813c5 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:41.146267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c1df5532-e8c9-4f1c-bb27-77fc35e813c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:41.217636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df5532-e8c9-4f1c-bb27-77fc35e813c5 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:41.221015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 898/1777] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:40 2022] PUT /identity/v3/projects/23b0b36d16724a9d880fc8366e9b855d/users/0f8981b4c9d7459b8981c4b8d61670bf/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:41.232937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2c134-1042-4980-9d1e-4417e96f11f8 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:41.233239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2c134-1042-4980-9d1e-4417e96f11f8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:41.233560 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2c134-1042-4980-9d1e-4417e96f11f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:41.275379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1ad2c134-1042-4980-9d1e-4417e96f11f8 None None] MFA Rules not processed for user `0f8981b4c9d7459b8981c4b8d61670bf`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:41.276573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1ad2c134-1042-4980-9d1e-4417e96f11f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:41.278445 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec45a2-88b4-45d2-9dd7-f6e56d888508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:41.279297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec45a2-88b4-45d2-9dd7-f6e56d888508 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:41.279627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec45a2-88b4-45d2-9dd7-f6e56d888508 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:41.279906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec45a2-88b4-45d2-9dd7-f6e56d888508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:41.349807 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec45a2-88b4-45d2-9dd7-f6e56d888508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:41.353458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 899/1778] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:41 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:41.357946 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2c134-1042-4980-9d1e-4417e96f11f8 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:41.375748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec45a2-88b4-45d2-9dd7-f6e56d888508 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:41.386025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 880/1779] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:41 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:10:41.432405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2c134-1042-4980-9d1e-4417e96f11f8 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:41.437951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3d27a-916a-444e-8927-660f5977471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:41.437951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3d27a-916a-444e-8927-660f5977471e admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:41.437951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3d27a-916a-444e-8927-660f5977471e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:41.437951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3d27a-916a-444e-8927-660f5977471e admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:41.438445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3d27a-916a-444e-8927-660f5977471e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:41.465654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3d27a-916a-444e-8927-660f5977471e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:41.645960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 900/1780] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:41 2022] POST /identity/v3/projects => generated 365 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:10:41.648583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec45a2-88b4-45d2-9dd7-f6e56d888508 service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:41.661481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec45a2-88b4-45d2-9dd7-f6e56d888508 service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:41.734282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932f545-3765-4a13-a5ac-526db2519564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:41.734950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932f545-3765-4a13-a5ac-526db2519564 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:41.735247 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932f545-3765-4a13-a5ac-526db2519564 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:41.735556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932f545-3765-4a13-a5ac-526db2519564 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:41.736224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932f545-3765-4a13-a5ac-526db2519564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:41.765774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3d27a-916a-444e-8927-660f5977471e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:41.765774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e5e3d27a-916a-444e-8927-660f5977471e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:41.770764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932f545-3765-4a13-a5ac-526db2519564 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:41.851069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3d27a-916a-444e-8927-660f5977471e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:41.855011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d826-8aaf-434a-bab4-eeec6516acd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:41.860152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d826-8aaf-434a-bab4-eeec6516acd6 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:41.860152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d826-8aaf-434a-bab4-eeec6516acd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:41.860152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8d826-8aaf-434a-bab4-eeec6516acd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:41.860152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-86d8d826-8aaf-434a-bab4-eeec6516acd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:41.888289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 881/1781] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:41 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:41.892564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932f545-3765-4a13-a5ac-526db2519564 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:41.904336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932f545-3765-4a13-a5ac-526db2519564 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:41.909095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ca4c2-ea57-459e-8968-7a44ab0d188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:41.918602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca4c2-ea57-459e-8968-7a44ab0d188c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:41.918602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca4c2-ea57-459e-8968-7a44ab0d188c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:41.918602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ca4c2-ea57-459e-8968-7a44ab0d188c admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:41.919264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ca4c2-ea57-459e-8968-7a44ab0d188c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:41.946211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8d826-8aaf-434a-bab4-eeec6516acd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:41.951114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ca4c2-ea57-459e-8968-7a44ab0d188c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:41.963167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 882/1782] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:41.966937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8d826-8aaf-434a-bab4-eeec6516acd6 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:41.967072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ca4c2-ea57-459e-8968-7a44ab0d188c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:41.977058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 901/1783] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:41 2022] GET /identity/v3/auth/tokens => generated 3670 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:41.988883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ca4c2-ea57-459e-8968-7a44ab0d188c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:41.994901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7330d3d-f9d2-49b7-9027-c4b53e77a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:41.995924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7330d3d-f9d2-49b7-9027-c4b53e77a29a admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:41.996330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7330d3d-f9d2-49b7-9027-c4b53e77a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:41.996981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7330d3d-f9d2-49b7-9027-c4b53e77a29a admin admin] PATH_INFO: `/v3/projects/8000409c476945b7ab82aa67c49f8873/users/f208b3b16a0042b59caeb8f1db1a5031/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:42.026960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7330d3d-f9d2-49b7-9027-c4b53e77a29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8000409c476945b7ab82aa67c49f8873, user_id=f208b3b16a0042b59caeb8f1db1a5031, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:42.073681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7330d3d-f9d2-49b7-9027-c4b53e77a29a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:42.194300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 883/1784] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:41 2022] PUT /identity/v3/projects/8000409c476945b7ab82aa67c49f8873/users/f208b3b16a0042b59caeb8f1db1a5031/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:42.198294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d826-8aaf-434a-bab4-eeec6516acd6 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:42.211205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8d826-8aaf-434a-bab4-eeec6516acd6 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:42.286476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42bfe0-e1d2-4733-899e-ede894f13c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:42.287981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42bfe0-e1d2-4733-899e-ede894f13c56 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:42.288282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42bfe0-e1d2-4733-899e-ede894f13c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:42.288708 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42bfe0-e1d2-4733-899e-ede894f13c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:42.289424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42bfe0-e1d2-4733-899e-ede894f13c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:42.332222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42bfe0-e1d2-4733-899e-ede894f13c56 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:42.348663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 902/1785] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:42.353685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7330d3d-f9d2-49b7-9027-c4b53e77a29a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:42.370763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7330d3d-f9d2-49b7-9027-c4b53e77a29a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:42.375690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75452c-be8e-4b8b-8401-b370c44a9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:42.376529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75452c-be8e-4b8b-8401-b370c44a9eea admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:42.376819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75452c-be8e-4b8b-8401-b370c44a9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:42.377133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75452c-be8e-4b8b-8401-b370c44a9eea admin admin] PATH_INFO: `/v3/projects/8000409c476945b7ab82aa67c49f8873/users/f208b3b16a0042b59caeb8f1db1a5031/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:42.381395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75452c-be8e-4b8b-8401-b370c44a9eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8000409c476945b7ab82aa67c49f8873, user_id=f208b3b16a0042b59caeb8f1db1a5031, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:42.412201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75452c-be8e-4b8b-8401-b370c44a9eea admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:42.426663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 884/1786] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:42 2022] PUT /identity/v3/projects/8000409c476945b7ab82aa67c49f8873/users/f208b3b16a0042b59caeb8f1db1a5031/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:42.434572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42bfe0-e1d2-4733-899e-ede894f13c56 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:42.447513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42bfe0-e1d2-4733-899e-ede894f13c56 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:42.515474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92fdec-73c5-4937-ab10-b29a6245b7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:42.516069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92fdec-73c5-4937-ab10-b29a6245b7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:42.516355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92fdec-73c5-4937-ab10-b29a6245b7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:42.516660 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92fdec-73c5-4937-ab10-b29a6245b7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:42.517342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92fdec-73c5-4937-ab10-b29a6245b7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:42.543354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92fdec-73c5-4937-ab10-b29a6245b7b4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:42.554747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 903/1787] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:42.559014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75452c-be8e-4b8b-8401-b370c44a9eea admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:42.569583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75452c-be8e-4b8b-8401-b370c44a9eea admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:42.573940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcf6ef-1113-4f20-b263-cbed5749bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:42.574748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf6ef-1113-4f20-b263-cbed5749bd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:42.575095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf6ef-1113-4f20-b263-cbed5749bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:42.575408 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fcf6ef-1113-4f20-b263-cbed5749bd00 admin admin] PATH_INFO: `/v3/projects/8000409c476945b7ab82aa67c49f8873/users/f208b3b16a0042b59caeb8f1db1a5031/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:42.577206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcf6ef-1113-4f20-b263-cbed5749bd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8000409c476945b7ab82aa67c49f8873, user_id=f208b3b16a0042b59caeb8f1db1a5031, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:42.606140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fcf6ef-1113-4f20-b263-cbed5749bd00 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:42.715836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 885/1788] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:42 2022] PUT /identity/v3/projects/8000409c476945b7ab82aa67c49f8873/users/f208b3b16a0042b59caeb8f1db1a5031/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:42.727539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ccc04-afa2-401b-bf9d-a7c055263391 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:42.727864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ccc04-afa2-401b-bf9d-a7c055263391 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:42.728168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ccc04-afa2-401b-bf9d-a7c055263391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:42.765734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b92ccc04-afa2-401b-bf9d-a7c055263391 None None] MFA Rules not processed for user `f208b3b16a0042b59caeb8f1db1a5031`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:42.767497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b92ccc04-afa2-401b-bf9d-a7c055263391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:42.851122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 904/1789] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:42 2022] POST /identity/v3/auth/tokens => generated 3739 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:42.875784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcf6ef-1113-4f20-b263-cbed5749bd00 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:42.949819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fcf6ef-1113-4f20-b263-cbed5749bd00 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:42.953200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9415d5e-d4ad-4d37-b52b-e2bfe9334a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:42.953783 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9415d5e-d4ad-4d37-b52b-e2bfe9334a3c service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:42.954100 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9415d5e-d4ad-4d37-b52b-e2bfe9334a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:42.954385 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9415d5e-d4ad-4d37-b52b-e2bfe9334a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:42.963554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9415d5e-d4ad-4d37-b52b-e2bfe9334a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:42.989889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9415d5e-d4ad-4d37-b52b-e2bfe9334a3c service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:42.999237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 886/1790] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:42 2022] GET /identity/v3/auth/tokens => generated 3739 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:43.569741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ccc04-afa2-401b-bf9d-a7c055263391 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:43.571333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b92ccc04-afa2-401b-bf9d-a7c055263391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:43.653034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9415d5e-d4ad-4d37-b52b-e2bfe9334a3c service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:43.668888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9415d5e-d4ad-4d37-b52b-e2bfe9334a3c service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:43.676246 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40609809-4be2-4330-9ff1-0bc24581b8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:43.678426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40609809-4be2-4330-9ff1-0bc24581b8ec service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:43.679032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40609809-4be2-4330-9ff1-0bc24581b8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:43.679505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40609809-4be2-4330-9ff1-0bc24581b8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:43.716697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ccc04-afa2-401b-bf9d-a7c055263391 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:43.716697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:43.716697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:43.716697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:43.717056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] PATH_INFO: `/v3/users/00a3f23cd76745fdbf1b7fc1a875cb92` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:43.717056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a3f23cd76745fdbf1b7fc1a875cb92)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:43.736125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:43.858985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40609809-4be2-4330-9ff1-0bc24581b8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:43.888096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40609809-4be2-4330-9ff1-0bc24581b8ec service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:43.899575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 887/1791] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:43 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:44.129157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a3f23cd76745fdbf1b7fc1a875cb92'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:44.132005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a3f23cd76745fdbf1b7fc1a875cb92'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:44.138043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a3f23cd76745fdbf1b7fc1a875cb92'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:44.150420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a3f23cd76745fdbf1b7fc1a875cb92'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:44.301951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a3f23cd76745fdbf1b7fc1a875cb92'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:44.312261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 905/1792] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:43 2022] DELETE /identity/v3/users/00a3f23cd76745fdbf1b7fc1a875cb92 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:44.317690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113cac-4c03-4e2d-8c18-c3adcf4e4dce None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:44.317916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113cac-4c03-4e2d-8c18-c3adcf4e4dce None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:44.318194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00113cac-4c03-4e2d-8c18-c3adcf4e4dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:44.342141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-00113cac-4c03-4e2d-8c18-c3adcf4e4dce None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:44.348635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-00113cac-4c03-4e2d-8c18-c3adcf4e4dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:44.423956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 888/1793] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:44 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:44.435177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:44.437166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:44.508790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc54b3f-4dc2-42b7-b6aa-58428c407589 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:44.513309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fcc6b-cff5-47b7-83f6-802a63fe3fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:44.514142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcc6b-cff5-47b7-83f6-802a63fe3fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:44.514671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcc6b-cff5-47b7-83f6-802a63fe3fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:44.514965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fcc6b-cff5-47b7-83f6-802a63fe3fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:44.526474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fcc6b-cff5-47b7-83f6-802a63fe3fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:44.554620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fcc6b-cff5-47b7-83f6-802a63fe3fd2 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:44.569471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 906/1794] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:44 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:45.476110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00113cac-4c03-4e2d-8c18-c3adcf4e4dce None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:45.477556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-00113cac-4c03-4e2d-8c18-c3adcf4e4dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:45.489527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00113cac-4c03-4e2d-8c18-c3adcf4e4dce None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:45.504634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:45.505581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:45.505972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:45.506847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] PATH_INFO: `/v3/projects/5e75706e93ae42d2a340fb1bea72c9f8` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:45.508233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e75706e93ae42d2a340fb1bea72c9f8)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:45.538161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:45.667792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e75706e93ae42d2a340fb1bea72c9f8', 'request_id': 'req-4de87f71-e694-43f3-a388-ac4b3f6de607'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:45.901241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e75706e93ae42d2a340fb1bea72c9f8', 'request_id': 'req-4de87f71-e694-43f3-a388-ac4b3f6de607'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:45.914836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e75706e93ae42d2a340fb1bea72c9f8', 'request_id': 'req-4de87f71-e694-43f3-a388-ac4b3f6de607'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:45.925054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] The token cache is being invalidate because project 5e75706e93ae42d2a340fb1bea72c9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:45.925804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:45.926299 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:45.927902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 889/1795] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:45 2022] DELETE /identity/v3/projects/5e75706e93ae42d2a340fb1bea72c9f8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:45.932090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fcc6b-cff5-47b7-83f6-802a63fe3fd2 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:45.944697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fcc6b-cff5-47b7-83f6-802a63fe3fd2 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:46.027729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:46.028358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:46.028651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:46.029195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] PATH_INFO: `/v3/users/1072607a3ab042ad808e9f24cdd03d68` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:46.030497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1072607a3ab042ad808e9f24cdd03d68)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:46.059906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:46.322037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1072607a3ab042ad808e9f24cdd03d68'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:46.323031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1072607a3ab042ad808e9f24cdd03d68'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:46.338244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1072607a3ab042ad808e9f24cdd03d68'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:46.353318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1072607a3ab042ad808e9f24cdd03d68'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:46.453765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1072607a3ab042ad808e9f24cdd03d68'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:46.467944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 907/1796] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:45 2022] DELETE /identity/v3/users/1072607a3ab042ad808e9f24cdd03d68 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:47.449342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:47.451164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:47.468305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87f71-e694-43f3-a388-ac4b3f6de607 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:47.588410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:47.589169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:47.589455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:47.589748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] PATH_INFO: `/v3/users/b8afc7b976604337a4117a540c695621` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:47.591881 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8afc7b976604337a4117a540c695621)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:47.620670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:47.766193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:47.769219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:47.804328 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e173b3-6c93-414c-be4b-28cfada82ce6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:47.828513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:47.829342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:47.829632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:47.829916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] PATH_INFO: `/v3/projects/64bca8800cbb455db3dc6f537fa45666` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:47.838238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64bca8800cbb455db3dc6f537fa45666)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:47.889494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:47.917101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8afc7b976604337a4117a540c695621'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:47.938782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8afc7b976604337a4117a540c695621'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:47.939409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8afc7b976604337a4117a540c695621'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:47.952926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8afc7b976604337a4117a540c695621'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:48.078208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-67bd4e1a-fbc8-4d5d-b3b1-805a2ab73215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8afc7b976604337a4117a540c695621'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:48.088705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 890/1797] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:47 2022] DELETE /identity/v3/users/b8afc7b976604337a4117a540c695621 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:48.093964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5d585-ef29-4aab-be8c-b7d874a86687 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:48.094671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5d585-ef29-4aab-be8c-b7d874a86687 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:48.095218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a5d585-ef29-4aab-be8c-b7d874a86687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:48.109620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64bca8800cbb455db3dc6f537fa45666', 'request_id': 'req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:48.126829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d1a5d585-ef29-4aab-be8c-b7d874a86687 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:48.129172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d1a5d585-ef29-4aab-be8c-b7d874a86687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:48.210946 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 891/1798] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:48.222718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5d585-ef29-4aab-be8c-b7d874a86687 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:48.224592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d1a5d585-ef29-4aab-be8c-b7d874a86687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:48.239082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64bca8800cbb455db3dc6f537fa45666', 'request_id': 'req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:48.256861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64bca8800cbb455db3dc6f537fa45666', 'request_id': 'req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:48.286147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] The token cache is being invalidate because project 64bca8800cbb455db3dc6f537fa45666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:48.286413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:48.292386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-32eb0064-b886-49de-9dd5-a30cc4f8f0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:48.293932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 908/1799] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:47 2022] DELETE /identity/v3/projects/64bca8800cbb455db3dc6f537fa45666 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:48.299625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1bae-ee37-4faf-b5a3-ac5d4c9b65d8 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:48.300636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1bae-ee37-4faf-b5a3-ac5d4c9b65d8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:48.303557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c1bae-ee37-4faf-b5a3-ac5d4c9b65d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:48.328882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a5d585-ef29-4aab-be8c-b7d874a86687 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:48.334741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fa9a9-f114-4205-b15f-a172f5bbfd97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:48.335444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa9a9-f114-4205-b15f-a172f5bbfd97 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:48.335796 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa9a9-f114-4205-b15f-a172f5bbfd97 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:48.336125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fa9a9-f114-4205-b15f-a172f5bbfd97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:48.339594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d62fa9a9-f114-4205-b15f-a172f5bbfd97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:48.341999 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-ae4c1bae-ee37-4faf-b5a3-ac5d4c9b65d8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:48.343383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ae4c1bae-ee37-4faf-b5a3-ac5d4c9b65d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:48.353791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fa9a9-f114-4205-b15f-a172f5bbfd97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:48.354290 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 909/1800] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:48.363281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7a164-afeb-4f0a-bc56-8e0d17b9364e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:48.363989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7a164-afeb-4f0a-bc56-8e0d17b9364e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:48.364488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7a164-afeb-4f0a-bc56-8e0d17b9364e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:48.384224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fa9a9-f114-4205-b15f-a172f5bbfd97 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:48.396085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 892/1801] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:48.402982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-17f7a164-afeb-4f0a-bc56-8e0d17b9364e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:48.404625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-17f7a164-afeb-4f0a-bc56-8e0d17b9364e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:48.412665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 910/1802] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:48.418136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fa9a9-f114-4205-b15f-a172f5bbfd97 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:48.431346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fa9a9-f114-4205-b15f-a172f5bbfd97 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:48.436934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e123c8-a0da-4ab0-b943-41072472f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:48.437544 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e123c8-a0da-4ab0-b943-41072472f33c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:48.437834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e123c8-a0da-4ab0-b943-41072472f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:48.438753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e123c8-a0da-4ab0-b943-41072472f33c admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:48.439574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e123c8-a0da-4ab0-b943-41072472f33c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:10:48.439884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e123c8-a0da-4ab0-b943-41072472f33c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:48.467142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e123c8-a0da-4ab0-b943-41072472f33c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:48.481420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 893/1803] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:10:48.486188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7a164-afeb-4f0a-bc56-8e0d17b9364e None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:48.504565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7a164-afeb-4f0a-bc56-8e0d17b9364e None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:48.514205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424b36-6815-4521-a428-94130610f6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:48.514822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424b36-6815-4521-a428-94130610f6de admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:48.515190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424b36-6815-4521-a428-94130610f6de admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:48.515477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424b36-6815-4521-a428-94130610f6de admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:48.516131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98424b36-6815-4521-a428-94130610f6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:48.573875 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98424b36-6815-4521-a428-94130610f6de admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:48.702424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 911/1804] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:48 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:48.706859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e123c8-a0da-4ab0-b943-41072472f33c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:48.725226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e123c8-a0da-4ab0-b943-41072472f33c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:48.815930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c7505-964b-4775-9dbb-1f762550c4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:48.816546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c7505-964b-4775-9dbb-1f762550c4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:48.816981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c7505-964b-4775-9dbb-1f762550c4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:48.817271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c7505-964b-4775-9dbb-1f762550c4c5 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:48.817939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c7505-964b-4775-9dbb-1f762550c4c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:48.854689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c7505-964b-4775-9dbb-1f762550c4c5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:48.959393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 894/1805] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:48 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:48.963515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424b36-6815-4521-a428-94130610f6de admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:48.974756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424b36-6815-4521-a428-94130610f6de admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:48.981950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6919d20-3c61-4576-a40a-b42cb5439eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:48.982823 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6919d20-3c61-4576-a40a-b42cb5439eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:48.983413 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6919d20-3c61-4576-a40a-b42cb5439eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:48.983756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6919d20-3c61-4576-a40a-b42cb5439eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:48.984678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6919d20-3c61-4576-a40a-b42cb5439eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:49.022153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6919d20-3c61-4576-a40a-b42cb5439eb6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:49.036029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 912/1806] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:10:49.039913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c7505-964b-4775-9dbb-1f762550c4c5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:49.053096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c7505-964b-4775-9dbb-1f762550c4c5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:49.060333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3d38f-c8f1-46f1-baf2-5c3c968628c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:49.062183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3d38f-c8f1-46f1-baf2-5c3c968628c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:49.063136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3d38f-c8f1-46f1-baf2-5c3c968628c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:49.063951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3d38f-c8f1-46f1-baf2-5c3c968628c1 admin admin] PATH_INFO: `/v3/projects/9471741b26204c92b55d9ebed1020e0d/users/5025d62943284c309a389c2c5b8ea4db/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:49.097943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3d38f-c8f1-46f1-baf2-5c3c968628c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9471741b26204c92b55d9ebed1020e0d, user_id=5025d62943284c309a389c2c5b8ea4db, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:49.156973 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b3d38f-c8f1-46f1-baf2-5c3c968628c1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:49.249166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 895/1807] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:49 2022] PUT /identity/v3/projects/9471741b26204c92b55d9ebed1020e0d/users/5025d62943284c309a389c2c5b8ea4db/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:49.261126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af908644-f9c6-4bcd-bfc7-47a27b7735bc None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:49.261755 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af908644-f9c6-4bcd-bfc7-47a27b7735bc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:49.262153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af908644-f9c6-4bcd-bfc7-47a27b7735bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:49.317618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-af908644-f9c6-4bcd-bfc7-47a27b7735bc None None] MFA Rules not processed for user `5025d62943284c309a389c2c5b8ea4db`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:49.319015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-af908644-f9c6-4bcd-bfc7-47a27b7735bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:49.382249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3d38f-c8f1-46f1-baf2-5c3c968628c1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:49.384334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-61b3d38f-c8f1-46f1-baf2-5c3c968628c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:49.442886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 913/1808] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:49 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:49.444441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af908644-f9c6-4bcd-bfc7-47a27b7735bc None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:49.477114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b3d38f-c8f1-46f1-baf2-5c3c968628c1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:49.482651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:49.483723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:49.484471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:49.484911 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] PATH_INFO: `/v3/projects/e63320e5c36044b9822c660674da35af` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:49.486219 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63320e5c36044b9822c660674da35af)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:49.517235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:49.601401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af908644-f9c6-4bcd-bfc7-47a27b7735bc None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:49.607216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabd355-53e0-4e4c-b838-9edae30189e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:49.607998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabd355-53e0-4e4c-b838-9edae30189e8 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:49.608298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabd355-53e0-4e4c-b838-9edae30189e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:49.608585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabd355-53e0-4e4c-b838-9edae30189e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:49.609230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabd355-53e0-4e4c-b838-9edae30189e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:49.638796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabd355-53e0-4e4c-b838-9edae30189e8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:49.686873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63320e5c36044b9822c660674da35af', 'request_id': 'req-b3a130a6-ab05-42a0-a037-387978f2dd38'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:49.752291 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 914/1809] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:49 2022] POST /identity/v3/projects => generated 375 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:49.756242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabd355-53e0-4e4c-b838-9edae30189e8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:49.831850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63320e5c36044b9822c660674da35af', 'request_id': 'req-b3a130a6-ab05-42a0-a037-387978f2dd38'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:49.845139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabd355-53e0-4e4c-b838-9edae30189e8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:49.850443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cab8a7-2042-49a0-8dfc-af3b97e9ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:49.851046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cab8a7-2042-49a0-8dfc-af3b97e9ac5d admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:49.851392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cab8a7-2042-49a0-8dfc-af3b97e9ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:49.851639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cab8a7-2042-49a0-8dfc-af3b97e9ac5d admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:49.852339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cab8a7-2042-49a0-8dfc-af3b97e9ac5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:49.864022 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63320e5c36044b9822c660674da35af', 'request_id': 'req-b3a130a6-ab05-42a0-a037-387978f2dd38'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:49.883103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] The token cache is being invalidate because project e63320e5c36044b9822c660674da35af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:49.883407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:49.884035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:49.885510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 896/1810] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:49 2022] DELETE /identity/v3/projects/e63320e5c36044b9822c660674da35af => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:49.889428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:49.896957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:49.897201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cab8a7-2042-49a0-8dfc-af3b97e9ac5d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:49.993838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a130a6-ab05-42a0-a037-387978f2dd38 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:49.998789 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:49.999335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:49.999619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:49.999894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] PATH_INFO: `/v3/users/45d3554650dd45089adb8918018b4022` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:50.001026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d3554650dd45089adb8918018b4022)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:50.044214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 915/1811] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:49 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:10:50.044727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:50.064952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cab8a7-2042-49a0-8dfc-af3b97e9ac5d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:50.067285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-20cab8a7-2042-49a0-8dfc-af3b97e9ac5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:50.098561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cab8a7-2042-49a0-8dfc-af3b97e9ac5d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:50.111839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366aad-11b3-4922-a30c-8a059113b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:50.113674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366aad-11b3-4922-a30c-8a059113b14e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:50.115011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366aad-11b3-4922-a30c-8a059113b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:50.115971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366aad-11b3-4922-a30c-8a059113b14e admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:50.116887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24366aad-11b3-4922-a30c-8a059113b14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:50.157545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24366aad-11b3-4922-a30c-8a059113b14e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:50.171369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 916/1812] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:10:50.176679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366aad-11b3-4922-a30c-8a059113b14e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:50.188219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366aad-11b3-4922-a30c-8a059113b14e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:50.194480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07c914-b0b2-4650-bd9c-ce356424b3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:50.195669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07c914-b0b2-4650-bd9c-ce356424b3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:50.196159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07c914-b0b2-4650-bd9c-ce356424b3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:50.196622 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07c914-b0b2-4650-bd9c-ce356424b3e5 admin admin] PATH_INFO: `/v3/projects/e828ca9bd173498f810912b1d39dbc53/users/0506f4653ab641a69a409f3ffe5c34e9/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:50.224007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07c914-b0b2-4650-bd9c-ce356424b3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e828ca9bd173498f810912b1d39dbc53, user_id=0506f4653ab641a69a409f3ffe5c34e9, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:50.256419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a07c914-b0b2-4650-bd9c-ce356424b3e5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:50.314897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d3554650dd45089adb8918018b4022'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:50.329733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 917/1813] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:50 2022] PUT /identity/v3/projects/e828ca9bd173498f810912b1d39dbc53/users/0506f4653ab641a69a409f3ffe5c34e9/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:50.334940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07c914-b0b2-4650-bd9c-ce356424b3e5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:50.344127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d3554650dd45089adb8918018b4022'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:50.347748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d3554650dd45089adb8918018b4022'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:50.373728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d3554650dd45089adb8918018b4022'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:50.476755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d3554650dd45089adb8918018b4022'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:50.483426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 897/1814] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:10:49 2022] DELETE /identity/v3/users/45d3554650dd45089adb8918018b4022 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:50.506033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07c914-b0b2-4650-bd9c-ce356424b3e5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:50.602157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe12c-119e-4ae3-8be3-8a33714de25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:50.603149 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe12c-119e-4ae3-8be3-8a33714de25f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:50.603632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe12c-119e-4ae3-8be3-8a33714de25f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:50.604254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febe12c-119e-4ae3-8be3-8a33714de25f admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:50.605176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febe12c-119e-4ae3-8be3-8a33714de25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:50.635652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febe12c-119e-4ae3-8be3-8a33714de25f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:50.655695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:50.655912 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 918/1815] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:50.657504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:50.677320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428889a-2aa6-46f6-b232-ed2c143f512e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:50.682259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb6a7-3a06-4066-8164-23cb8f41c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:50.683198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb6a7-3a06-4066-8164-23cb8f41c57d admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:50.683584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb6a7-3a06-4066-8164-23cb8f41c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:50.683937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb6a7-3a06-4066-8164-23cb8f41c57d admin admin] PATH_INFO: `/v3/projects/e828ca9bd173498f810912b1d39dbc53/users/0506f4653ab641a69a409f3ffe5c34e9/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:50.687585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affb6a7-3a06-4066-8164-23cb8f41c57d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e828ca9bd173498f810912b1d39dbc53, user_id=0506f4653ab641a69a409f3ffe5c34e9, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:50.725186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affb6a7-3a06-4066-8164-23cb8f41c57d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:50.745194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe12c-119e-4ae3-8be3-8a33714de25f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:50.755619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 898/1816] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:50 2022] PUT /identity/v3/projects/e828ca9bd173498f810912b1d39dbc53/users/0506f4653ab641a69a409f3ffe5c34e9/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:50.756162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febe12c-119e-4ae3-8be3-8a33714de25f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:50.845937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefb5fe-f986-4d6c-aa44-20a9af65c342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:50.846662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefb5fe-f986-4d6c-aa44-20a9af65c342 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:50.847022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefb5fe-f986-4d6c-aa44-20a9af65c342 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:50.847574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefb5fe-f986-4d6c-aa44-20a9af65c342 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:50.848438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefb5fe-f986-4d6c-aa44-20a9af65c342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:50.876281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefb5fe-f986-4d6c-aa44-20a9af65c342 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:50.890324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 919/1817] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:50.896454 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb6a7-3a06-4066-8164-23cb8f41c57d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:50.908632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb6a7-3a06-4066-8164-23cb8f41c57d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:50.923620 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fc87a-c1bf-4823-85dd-8b48e4c99bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:50.926025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fc87a-c1bf-4823-85dd-8b48e4c99bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:50.926333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fc87a-c1bf-4823-85dd-8b48e4c99bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:50.926621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fc87a-c1bf-4823-85dd-8b48e4c99bf3 admin admin] PATH_INFO: `/v3/projects/e828ca9bd173498f810912b1d39dbc53/users/0506f4653ab641a69a409f3ffe5c34e9/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:50.934898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fc87a-c1bf-4823-85dd-8b48e4c99bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e828ca9bd173498f810912b1d39dbc53, user_id=0506f4653ab641a69a409f3ffe5c34e9, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:50.990117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fc87a-c1bf-4823-85dd-8b48e4c99bf3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:51.147854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 899/1818] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:50 2022] PUT /identity/v3/projects/e828ca9bd173498f810912b1d39dbc53/users/0506f4653ab641a69a409f3ffe5c34e9/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:51.149145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994bfa2-978f-4b40-ae2f-26bd7142c742 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:51.149561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994bfa2-978f-4b40-ae2f-26bd7142c742 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:51.149878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994bfa2-978f-4b40-ae2f-26bd7142c742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:51.198625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-0994bfa2-978f-4b40-ae2f-26bd7142c742 None None] MFA Rules not processed for user `0506f4653ab641a69a409f3ffe5c34e9`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:51.202441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0994bfa2-978f-4b40-ae2f-26bd7142c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:51.301755 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 920/1819] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:51 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:51.312430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fc87a-c1bf-4823-85dd-8b48e4c99bf3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:51.314566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1e8fc87a-c1bf-4823-85dd-8b48e4c99bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:51.394359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fc87a-c1bf-4823-85dd-8b48e4c99bf3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:51.407010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ac1cf-eb2e-44f9-ae6c-7e7e6afb2788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:51.407010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ac1cf-eb2e-44f9-ae6c-7e7e6afb2788 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:51.407010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ac1cf-eb2e-44f9-ae6c-7e7e6afb2788 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:51.407010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ac1cf-eb2e-44f9-ae6c-7e7e6afb2788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:51.407358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-987ac1cf-eb2e-44f9-ae6c-7e7e6afb2788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:51.484740 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ac1cf-eb2e-44f9-ae6c-7e7e6afb2788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:51.510934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ac1cf-eb2e-44f9-ae6c-7e7e6afb2788 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:51.521536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 900/1820] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:51 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:51.530288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994bfa2-978f-4b40-ae2f-26bd7142c742 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:51.531749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0994bfa2-978f-4b40-ae2f-26bd7142c742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:51.617254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994bfa2-978f-4b40-ae2f-26bd7142c742 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:51.621857 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:51.627484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:51.627484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:51.627484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] PATH_INFO: `/v3/projects/a16e88d6abd240d1ab3b76f77f8ecafe` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:51.627484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16e88d6abd240d1ab3b76f77f8ecafe)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:51.653787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:51.867869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16e88d6abd240d1ab3b76f77f8ecafe', 'request_id': 'req-483c51b2-d332-4405-bb1b-59d89c915758'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:52.020425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16e88d6abd240d1ab3b76f77f8ecafe', 'request_id': 'req-483c51b2-d332-4405-bb1b-59d89c915758'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:52.032920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16e88d6abd240d1ab3b76f77f8ecafe', 'request_id': 'req-483c51b2-d332-4405-bb1b-59d89c915758'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:52.044391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] The token cache is being invalidate because project a16e88d6abd240d1ab3b76f77f8ecafe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:10:52.044697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:52.045304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-483c51b2-d332-4405-bb1b-59d89c915758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:10:52.047335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 921/1821] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:10:51 2022] DELETE /identity/v3/projects/a16e88d6abd240d1ab3b76f77f8ecafe => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:52.054009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01dfcf-d70f-40ba-afef-1f242f15b645 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:52.054377 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01dfcf-d70f-40ba-afef-1f242f15b645 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:52.054725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01dfcf-d70f-40ba-afef-1f242f15b645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:52.079492 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-bc01dfcf-d70f-40ba-afef-1f242f15b645 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:52.080723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bc01dfcf-d70f-40ba-afef-1f242f15b645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:52.169648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 901/1822] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:52.178472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde4a7c-06d1-4dbf-a807-678717d87789 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:52.178973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde4a7c-06d1-4dbf-a807-678717d87789 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:52.179202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde4a7c-06d1-4dbf-a807-678717d87789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:52.201736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-2cde4a7c-06d1-4dbf-a807-678717d87789 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:52.202970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2cde4a7c-06d1-4dbf-a807-678717d87789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:52.210655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 922/1823] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:10:52.214978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01dfcf-d70f-40ba-afef-1f242f15b645 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:52.225375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01dfcf-d70f-40ba-afef-1f242f15b645 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:52.229787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006334f-c249-48ef-8a6d-f416893b8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:52.234128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006334f-c249-48ef-8a6d-f416893b8f32 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:52.234128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006334f-c249-48ef-8a6d-f416893b8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:52.234128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006334f-c249-48ef-8a6d-f416893b8f32 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:52.234128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006334f-c249-48ef-8a6d-f416893b8f32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:10:52.234128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006334f-c249-48ef-8a6d-f416893b8f32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:52.258366 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b006334f-c249-48ef-8a6d-f416893b8f32 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:52.272564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 902/1824] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:10:52.277130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde4a7c-06d1-4dbf-a807-678717d87789 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:52.286895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde4a7c-06d1-4dbf-a807-678717d87789 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:52.291117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434da7e8-bd38-487f-be50-7ee6fcf8792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:52.291735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434da7e8-bd38-487f-be50-7ee6fcf8792b admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:52.292019 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434da7e8-bd38-487f-be50-7ee6fcf8792b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:52.292299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434da7e8-bd38-487f-be50-7ee6fcf8792b admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:52.292940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434da7e8-bd38-487f-be50-7ee6fcf8792b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:52.318488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434da7e8-bd38-487f-be50-7ee6fcf8792b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:52.438700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 923/1825] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:52 2022] POST /identity/v3/projects => generated 401 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:52.444665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006334f-c249-48ef-8a6d-f416893b8f32 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:52.456492 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006334f-c249-48ef-8a6d-f416893b8f32 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:52.568268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b040e7-fff3-4ee4-875f-c08b06a99c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:52.568993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b040e7-fff3-4ee4-875f-c08b06a99c15 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:52.569325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b040e7-fff3-4ee4-875f-c08b06a99c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:52.569673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b040e7-fff3-4ee4-875f-c08b06a99c15 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:52.570401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b040e7-fff3-4ee4-875f-c08b06a99c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:52.598422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b040e7-fff3-4ee4-875f-c08b06a99c15 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:52.701302 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 903/1826] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:52 2022] POST /identity/v3/users => generated 301 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:10:52.705728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434da7e8-bd38-487f-be50-7ee6fcf8792b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:52.717502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434da7e8-bd38-487f-be50-7ee6fcf8792b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:52.722133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3bd5b-4d10-4ada-b9c6-9780514394cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:52.722914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bd5b-4d10-4ada-b9c6-9780514394cd admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:52.723202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bd5b-4d10-4ada-b9c6-9780514394cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:52.723506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3bd5b-4d10-4ada-b9c6-9780514394cd admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:52.724252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3bd5b-4d10-4ada-b9c6-9780514394cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:52.750552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3bd5b-4d10-4ada-b9c6-9780514394cd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:52.761778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 924/1827] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:52.766036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b040e7-fff3-4ee4-875f-c08b06a99c15 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:52.776681 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b040e7-fff3-4ee4-875f-c08b06a99c15 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:52.781309 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a5fc0-b4cb-4b0d-989d-e216a8628800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:52.782115 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a5fc0-b4cb-4b0d-989d-e216a8628800 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:52.782403 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a5fc0-b4cb-4b0d-989d-e216a8628800 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:52.782713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a5fc0-b4cb-4b0d-989d-e216a8628800 admin admin] PATH_INFO: `/v3/projects/42e233a544c54bc68a850f2b5eed9e06/users/069091da6b3447d2a6e85af090df3ba2/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:52.802361 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a5fc0-b4cb-4b0d-989d-e216a8628800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e233a544c54bc68a850f2b5eed9e06, user_id=069091da6b3447d2a6e85af090df3ba2, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:52.830430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a5fc0-b4cb-4b0d-989d-e216a8628800 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:52.924052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 904/1828] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:52 2022] PUT /identity/v3/projects/42e233a544c54bc68a850f2b5eed9e06/users/069091da6b3447d2a6e85af090df3ba2/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:52.935120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc3c85-0b19-4911-932d-012ee3668e48 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:52.935457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc3c85-0b19-4911-932d-012ee3668e48 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:52.935744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc3c85-0b19-4911-932d-012ee3668e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:52.971947 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-96fc3c85-0b19-4911-932d-012ee3668e48 None None] MFA Rules not processed for user `069091da6b3447d2a6e85af090df3ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:52.973173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-96fc3c85-0b19-4911-932d-012ee3668e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:53.057508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 925/1829] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:52 2022] POST /identity/v3/auth/tokens => generated 3708 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:53.061904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a5fc0-b4cb-4b0d-989d-e216a8628800 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:53.131522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a5fc0-b4cb-4b0d-989d-e216a8628800 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:53.135806 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d9cf-5516-4eae-ba07-d06b140a9d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:53.136391 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d9cf-5516-4eae-ba07-d06b140a9d88 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:53.136680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d9cf-5516-4eae-ba07-d06b140a9d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:53.136958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1d9cf-5516-4eae-ba07-d06b140a9d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:53.137586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1d9cf-5516-4eae-ba07-d06b140a9d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:53.165737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c1d9cf-5516-4eae-ba07-d06b140a9d88 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:53.287184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 905/1830] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:10:53 2022] POST /identity/v3/projects => generated 401 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:10:53.291554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc3c85-0b19-4911-932d-012ee3668e48 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:53.302568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc3c85-0b19-4911-932d-012ee3668e48 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:53.364927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b47840-1fd3-43e3-b7b3-f41d07f792bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:53.365509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b47840-1fd3-43e3-b7b3-f41d07f792bf admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:53.365803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b47840-1fd3-43e3-b7b3-f41d07f792bf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:53.366079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b47840-1fd3-43e3-b7b3-f41d07f792bf admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:53.366727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b47840-1fd3-43e3-b7b3-f41d07f792bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:53.392314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b47840-1fd3-43e3-b7b3-f41d07f792bf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:53.505883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 926/1831] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:10:53 2022] POST /identity/v3/users => generated 307 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:10:53.509904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d9cf-5516-4eae-ba07-d06b140a9d88 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:53.520727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c1d9cf-5516-4eae-ba07-d06b140a9d88 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:53.525457 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1559f-831b-41e3-9d1d-a691a2cbce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:53.526078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1559f-831b-41e3-9d1d-a691a2cbce8c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:53.526352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1559f-831b-41e3-9d1d-a691a2cbce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:53.526641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1559f-831b-41e3-9d1d-a691a2cbce8c admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:53.527452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1559f-831b-41e3-9d1d-a691a2cbce8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:53.554737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1559f-831b-41e3-9d1d-a691a2cbce8c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:53.569650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 906/1832] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:53.573299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b47840-1fd3-43e3-b7b3-f41d07f792bf admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:53.583367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b47840-1fd3-43e3-b7b3-f41d07f792bf admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:53.587730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18185363-06d5-470c-8a30-816b187a4d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:53.588561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18185363-06d5-470c-8a30-816b187a4d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:53.588854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18185363-06d5-470c-8a30-816b187a4d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:53.589141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18185363-06d5-470c-8a30-816b187a4d4a admin admin] PATH_INFO: `/v3/projects/d5f58b2eab1044ad868d57f1663f0b90/users/4961827898144162b7e5a0ef803ffdf8/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:53.610992 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18185363-06d5-470c-8a30-816b187a4d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f58b2eab1044ad868d57f1663f0b90, user_id=4961827898144162b7e5a0ef803ffdf8, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:53.639719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18185363-06d5-470c-8a30-816b187a4d4a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:53.760306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 927/1833] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:53 2022] PUT /identity/v3/projects/d5f58b2eab1044ad868d57f1663f0b90/users/4961827898144162b7e5a0ef803ffdf8/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:10:53.765208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1559f-831b-41e3-9d1d-a691a2cbce8c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:53.776177 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1559f-831b-41e3-9d1d-a691a2cbce8c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:53.850148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a5090-73f0-4d8c-b705-96615a5c5c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:53.850847 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a5090-73f0-4d8c-b705-96615a5c5c09 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:53.851135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a5090-73f0-4d8c-b705-96615a5c5c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:53.851478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a5090-73f0-4d8c-b705-96615a5c5c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:53.852182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a5090-73f0-4d8c-b705-96615a5c5c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:53.878899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a5090-73f0-4d8c-b705-96615a5c5c09 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:53.890223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 907/1834] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:53.895451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18185363-06d5-470c-8a30-816b187a4d4a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:53.906009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18185363-06d5-470c-8a30-816b187a4d4a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:53.911511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770513c-df4b-4f44-8d28-5459d4e4f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:53.912364 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770513c-df4b-4f44-8d28-5459d4e4f799 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:53.912797 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770513c-df4b-4f44-8d28-5459d4e4f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:53.913089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770513c-df4b-4f44-8d28-5459d4e4f799 admin admin] PATH_INFO: `/v3/projects/d5f58b2eab1044ad868d57f1663f0b90/users/4961827898144162b7e5a0ef803ffdf8/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:53.914888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770513c-df4b-4f44-8d28-5459d4e4f799 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f58b2eab1044ad868d57f1663f0b90, user_id=4961827898144162b7e5a0ef803ffdf8, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:53.943467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770513c-df4b-4f44-8d28-5459d4e4f799 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:53.953958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 928/1835] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:53 2022] PUT /identity/v3/projects/d5f58b2eab1044ad868d57f1663f0b90/users/4961827898144162b7e5a0ef803ffdf8/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:53.959043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a5090-73f0-4d8c-b705-96615a5c5c09 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:53.968690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a5090-73f0-4d8c-b705-96615a5c5c09 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:54.033183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d5915-ee55-4f83-a5e9-2b08f8bbb7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:54.033788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d5915-ee55-4f83-a5e9-2b08f8bbb7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:54.034784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d5915-ee55-4f83-a5e9-2b08f8bbb7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:54.040959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d5915-ee55-4f83-a5e9-2b08f8bbb7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:54.040959 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d5915-ee55-4f83-a5e9-2b08f8bbb7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:54.061424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d5915-ee55-4f83-a5e9-2b08f8bbb7b9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:54.072737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 908/1836] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:10:54.077043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770513c-df4b-4f44-8d28-5459d4e4f799 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:54.087615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770513c-df4b-4f44-8d28-5459d4e4f799 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:54.092347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8486-dc1e-44e5-a65d-8ec841f40b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:54.093204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8486-dc1e-44e5-a65d-8ec841f40b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:54.093492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8486-dc1e-44e5-a65d-8ec841f40b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:54.093773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8486-dc1e-44e5-a65d-8ec841f40b9f admin admin] PATH_INFO: `/v3/projects/d5f58b2eab1044ad868d57f1663f0b90/users/4961827898144162b7e5a0ef803ffdf8/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:54.095823 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e8486-dc1e-44e5-a65d-8ec841f40b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f58b2eab1044ad868d57f1663f0b90, user_id=4961827898144162b7e5a0ef803ffdf8, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:54.122464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e8486-dc1e-44e5-a65d-8ec841f40b9f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:54.262616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 929/1837] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:10:54 2022] PUT /identity/v3/projects/d5f58b2eab1044ad868d57f1663f0b90/users/4961827898144162b7e5a0ef803ffdf8/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:10:54.273544 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076700-f99c-4375-82c6-25b570dc1ae9 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:54.273890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076700-f99c-4375-82c6-25b570dc1ae9 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:54.274131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b076700-f99c-4375-82c6-25b570dc1ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:54.311285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-8b076700-f99c-4375-82c6-25b570dc1ae9 None None] MFA Rules not processed for user `4961827898144162b7e5a0ef803ffdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:10:54.312489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8b076700-f99c-4375-82c6-25b570dc1ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:54.390121 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 909/1838] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:10:54 2022] POST /identity/v3/auth/tokens => generated 3775 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:10:54.399694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8486-dc1e-44e5-a65d-8ec841f40b9f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:54.401309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ae2e8486-dc1e-44e5-a65d-8ec841f40b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:10:54.465630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8486-dc1e-44e5-a65d-8ec841f40b9f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:54.469091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67133a5c-19f4-4b75-97ce-ade8fd7b1008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:54.469667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67133a5c-19f4-4b75-97ce-ade8fd7b1008 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:54.469950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67133a5c-19f4-4b75-97ce-ade8fd7b1008 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:54.470233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67133a5c-19f4-4b75-97ce-ade8fd7b1008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:54.480196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67133a5c-19f4-4b75-97ce-ade8fd7b1008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:54.505760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67133a5c-19f4-4b75-97ce-ade8fd7b1008 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:54.515381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 930/1839] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:54 2022] GET /identity/v3/auth/tokens => generated 3775 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:10:54.895730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076700-f99c-4375-82c6-25b570dc1ae9 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:10:54.906074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b076700-f99c-4375-82c6-25b570dc1ae9 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:10:54.909940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c82ea-758c-4737-8e48-d25998d8fdb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:10:54.910528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c82ea-758c-4737-8e48-d25998d8fdb2 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:10:54.910879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c82ea-758c-4737-8e48-d25998d8fdb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:10:54.911070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c82ea-758c-4737-8e48-d25998d8fdb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:10:54.976449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c82ea-758c-4737-8e48-d25998d8fdb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:10:55.001509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c82ea-758c-4737-8e48-d25998d8fdb2 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:10:55.011510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 910/1840] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:10:54 2022] GET /identity/v3/auth/tokens => generated 3708 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:04.086846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67133a5c-19f4-4b75-97ce-ade8fd7b1008 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:04.095272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67133a5c-19f4-4b75-97ce-ade8fd7b1008 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:04.099606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ca335-dff0-4476-8b6b-d976f563614d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:04.100207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ca335-dff0-4476-8b6b-d976f563614d service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:04.100476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ca335-dff0-4476-8b6b-d976f563614d service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:04.100759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ca335-dff0-4476-8b6b-d976f563614d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:04.102420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d22ca335-dff0-4476-8b6b-d976f563614d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:04.201294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ca335-dff0-4476-8b6b-d976f563614d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:04.229844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ca335-dff0-4476-8b6b-d976f563614d service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:04.240532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 931/1841] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:04 2022] GET /identity/v3/auth/tokens => generated 3749 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:06.639649 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c82ea-758c-4737-8e48-d25998d8fdb2 service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:06.709987 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c82ea-758c-4737-8e48-d25998d8fdb2 service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:06.714317 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:06.715118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:06.715431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:06.715716 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] PATH_INFO: `/v3/users/069091da6b3447d2a6e85af090df3ba2` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:06.716804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=069091da6b3447d2a6e85af090df3ba2)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:06.743366 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:07.005982 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069091da6b3447d2a6e85af090df3ba2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:07.017775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069091da6b3447d2a6e85af090df3ba2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:07.019209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069091da6b3447d2a6e85af090df3ba2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:07.026244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069091da6b3447d2a6e85af090df3ba2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:07.083698 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069091da6b3447d2a6e85af090df3ba2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:07.090086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 911/1842] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:06 2022] DELETE /identity/v3/users/069091da6b3447d2a6e85af090df3ba2 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:07.094806 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b98222-bcf3-49cd-a4e8-8753f848ac99 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:07.095274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b98222-bcf3-49cd-a4e8-8753f848ac99 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:07.095431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b98222-bcf3-49cd-a4e8-8753f848ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:07.119275 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e8b98222-bcf3-49cd-a4e8-8753f848ac99 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:07.120468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e8b98222-bcf3-49cd-a4e8-8753f848ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:07.185417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 932/1843] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:07.196183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:07.197531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:07.270929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b26eb-c0e1-4f43-9a3b-b6d34cd2e30e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:07.274264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691919d-054f-4ce2-8f0d-ef4cf363afdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:07.274840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691919d-054f-4ce2-8f0d-ef4cf363afdc service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:07.275124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691919d-054f-4ce2-8f0d-ef4cf363afdc service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:07.275433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691919d-054f-4ce2-8f0d-ef4cf363afdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:07.284979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691919d-054f-4ce2-8f0d-ef4cf363afdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:07.310475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691919d-054f-4ce2-8f0d-ef4cf363afdc service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:07.320935 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 912/1844] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:07 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:07.916709 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b98222-bcf3-49cd-a4e8-8753f848ac99 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:07.917704 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e8b98222-bcf3-49cd-a4e8-8753f848ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:07.929863 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b98222-bcf3-49cd-a4e8-8753f848ac99 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:07.934190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:07.934971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:07.935259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:07.935608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] PATH_INFO: `/v3/projects/42e233a544c54bc68a850f2b5eed9e06` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:07.936722 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e233a544c54bc68a850f2b5eed9e06)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:07.962835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:08.119285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e233a544c54bc68a850f2b5eed9e06', 'request_id': 'req-f22ce5f8-f909-428b-b7b1-587a48a408ff'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.198007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e233a544c54bc68a850f2b5eed9e06', 'request_id': 'req-f22ce5f8-f909-428b-b7b1-587a48a408ff'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.210074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e233a544c54bc68a850f2b5eed9e06', 'request_id': 'req-f22ce5f8-f909-428b-b7b1-587a48a408ff'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.219978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] The token cache is being invalidate because project 42e233a544c54bc68a850f2b5eed9e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:08.220269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.220892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.223066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 933/1845] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:07 2022] DELETE /identity/v3/projects/42e233a544c54bc68a850f2b5eed9e06 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:08.227040 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691919d-054f-4ce2-8f0d-ef4cf363afdc service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:08.236396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691919d-054f-4ce2-8f0d-ef4cf363afdc service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:08.311846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:08.312643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:08.312930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:08.313210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] PATH_INFO: `/v3/users/4961827898144162b7e5a0ef803ffdf8` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:08.314287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=4961827898144162b7e5a0ef803ffdf8)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:08.340190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:08.520853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4961827898144162b7e5a0ef803ffdf8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.533044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4961827898144162b7e5a0ef803ffdf8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.533824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4961827898144162b7e5a0ef803ffdf8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.549198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4961827898144162b7e5a0ef803ffdf8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.609437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-89ad475a-a22d-453f-97d4-f2ddaeace8ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4961827898144162b7e5a0ef803ffdf8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:08.617390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 913/1846] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:08 2022] DELETE /identity/v3/users/4961827898144162b7e5a0ef803ffdf8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:09.239687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:09.241925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:09.260961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ce5f8-f909-428b-b7b1-587a48a408ff admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:09.326515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:09.327335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:09.327703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:09.327893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] PATH_INFO: `/v3/projects/d5f58b2eab1044ad868d57f1663f0b90` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:09.329000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f58b2eab1044ad868d57f1663f0b90)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:09.355887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:09.501592 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f58b2eab1044ad868d57f1663f0b90', 'request_id': 'req-5d892deb-7562-477a-b9d4-dd7269f9bb3f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:09.590727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f58b2eab1044ad868d57f1663f0b90', 'request_id': 'req-5d892deb-7562-477a-b9d4-dd7269f9bb3f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:09.603278 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f58b2eab1044ad868d57f1663f0b90', 'request_id': 'req-5d892deb-7562-477a-b9d4-dd7269f9bb3f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:09.613362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] The token cache is being invalidate because project d5f58b2eab1044ad868d57f1663f0b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:09.613655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:09.614271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5d892deb-7562-477a-b9d4-dd7269f9bb3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:09.615761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 934/1847] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:09 2022] DELETE /identity/v3/projects/d5f58b2eab1044ad868d57f1663f0b90 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:09.621410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0af9c-ee1c-48ef-ae60-7f29d62094d1 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:09.621870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0af9c-ee1c-48ef-ae60-7f29d62094d1 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:09.622051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0af9c-ee1c-48ef-ae60-7f29d62094d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:09.647370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-48d0af9c-ee1c-48ef-ae60-7f29d62094d1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:09.648526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-48d0af9c-ee1c-48ef-ae60-7f29d62094d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:09.715995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 914/1848] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:09.725887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee51a86-d91b-444a-9074-01d97fef529d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:09.726276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee51a86-d91b-444a-9074-01d97fef529d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:09.726564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee51a86-d91b-444a-9074-01d97fef529d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:09.748469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-9ee51a86-d91b-444a-9074-01d97fef529d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:09.749600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-9ee51a86-d91b-444a-9074-01d97fef529d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:09.756886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 935/1849] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:09.761051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0af9c-ee1c-48ef-ae60-7f29d62094d1 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:09.770840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0af9c-ee1c-48ef-ae60-7f29d62094d1 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:09.775066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60755d51-c226-4dec-801e-b96f3c98493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:09.775701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60755d51-c226-4dec-801e-b96f3c98493e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:09.775987 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60755d51-c226-4dec-801e-b96f3c98493e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:09.776265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60755d51-c226-4dec-801e-b96f3c98493e admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:09.776954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60755d51-c226-4dec-801e-b96f3c98493e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:11:09.777277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60755d51-c226-4dec-801e-b96f3c98493e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:09.803505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60755d51-c226-4dec-801e-b96f3c98493e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:09.817439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 915/1850] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:11:09.821900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee51a86-d91b-444a-9074-01d97fef529d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:09.830804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee51a86-d91b-444a-9074-01d97fef529d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:09.836195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26005c86-639d-40c1-8bae-3e665ca12ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:09.836774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26005c86-639d-40c1-8bae-3e665ca12ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:09.837056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26005c86-639d-40c1-8bae-3e665ca12ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:09.837336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26005c86-639d-40c1-8bae-3e665ca12ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:09.837961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26005c86-639d-40c1-8bae-3e665ca12ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:09.863719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26005c86-639d-40c1-8bae-3e665ca12ea5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:09.953285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 936/1851] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:09 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:09.958029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60755d51-c226-4dec-801e-b96f3c98493e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:09.967542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60755d51-c226-4dec-801e-b96f3c98493e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:10.029783 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea03ca-aceb-43f6-b684-ee67422af6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:10.030382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea03ca-aceb-43f6-b684-ee67422af6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:10.030671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea03ca-aceb-43f6-b684-ee67422af6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:10.030950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea03ca-aceb-43f6-b684-ee67422af6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:10.031622 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea03ca-aceb-43f6-b684-ee67422af6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:10.057325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea03ca-aceb-43f6-b684-ee67422af6d6 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:10.146142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 916/1852] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:09 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:10.150458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26005c86-639d-40c1-8bae-3e665ca12ea5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:10.161192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26005c86-639d-40c1-8bae-3e665ca12ea5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:10.165498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17a204-6f02-4fb2-a763-ea3c12293109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:10.171226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17a204-6f02-4fb2-a763-ea3c12293109 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:10.171226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17a204-6f02-4fb2-a763-ea3c12293109 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:10.171226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17a204-6f02-4fb2-a763-ea3c12293109 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:10.171226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17a204-6f02-4fb2-a763-ea3c12293109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:10.194507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17a204-6f02-4fb2-a763-ea3c12293109 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:10.204973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 937/1853] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:11:10.209256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea03ca-aceb-43f6-b684-ee67422af6d6 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:10.218769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea03ca-aceb-43f6-b684-ee67422af6d6 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:10.223057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657b18-52d4-45e2-9c6f-78231f70884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:10.223916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657b18-52d4-45e2-9c6f-78231f70884f admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:10.224204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657b18-52d4-45e2-9c6f-78231f70884f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:10.224481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657b18-52d4-45e2-9c6f-78231f70884f admin admin] PATH_INFO: `/v3/projects/fc47a08d2e7f4926bd2cd7625db83522/users/f50c4c1b68694d498f552abe1970fba6/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:10.245287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da657b18-52d4-45e2-9c6f-78231f70884f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc47a08d2e7f4926bd2cd7625db83522, user_id=f50c4c1b68694d498f552abe1970fba6, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:10.274046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da657b18-52d4-45e2-9c6f-78231f70884f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:10.358664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 917/1854] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:10 2022] PUT /identity/v3/projects/fc47a08d2e7f4926bd2cd7625db83522/users/f50c4c1b68694d498f552abe1970fba6/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:10.373519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8653af-9b72-41e4-894e-57f9ead34e1a None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:10.374369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8653af-9b72-41e4-894e-57f9ead34e1a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:10.374656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8653af-9b72-41e4-894e-57f9ead34e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:10.412632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1d8653af-9b72-41e4-894e-57f9ead34e1a None None] MFA Rules not processed for user `f50c4c1b68694d498f552abe1970fba6`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:10.413684 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1d8653af-9b72-41e4-894e-57f9ead34e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:10.485576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 938/1855] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:10 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:10.495535 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657b18-52d4-45e2-9c6f-78231f70884f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:10.497121 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-da657b18-52d4-45e2-9c6f-78231f70884f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:10.564101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657b18-52d4-45e2-9c6f-78231f70884f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:10.568042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c70e2-5d1d-4ff0-8cfa-fa4feb3e76ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:10.568626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c70e2-5d1d-4ff0-8cfa-fa4feb3e76ed service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:10.568908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c70e2-5d1d-4ff0-8cfa-fa4feb3e76ed service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:10.569185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c70e2-5d1d-4ff0-8cfa-fa4feb3e76ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:10.577893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c70e2-5d1d-4ff0-8cfa-fa4feb3e76ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:10.603653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c70e2-5d1d-4ff0-8cfa-fa4feb3e76ed service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:10.613027 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 918/1856] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:10 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:22.434363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8653af-9b72-41e4-894e-57f9ead34e1a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:22.435826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1d8653af-9b72-41e4-894e-57f9ead34e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:22.506634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8653af-9b72-41e4-894e-57f9ead34e1a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:22.512076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:22.512865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:22.513151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:22.513428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] PATH_INFO: `/v3/users/0f8981b4c9d7459b8981c4b8d61670bf` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:22.514506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8981b4c9d7459b8981c4b8d61670bf)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:22.540581 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:22.768738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8981b4c9d7459b8981c4b8d61670bf'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:22.769400 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8981b4c9d7459b8981c4b8d61670bf'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:22.778507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8981b4c9d7459b8981c4b8d61670bf'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:22.791613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8981b4c9d7459b8981c4b8d61670bf'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:22.883932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8981b4c9d7459b8981c4b8d61670bf'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:22.890623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 939/1857] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:22 2022] DELETE /identity/v3/users/0f8981b4c9d7459b8981c4b8d61670bf => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:22.895275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785898a-19c4-4b42-8946-507441b52d7b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:22.895821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785898a-19c4-4b42-8946-507441b52d7b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:22.896171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785898a-19c4-4b42-8946-507441b52d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:22.920859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-0785898a-19c4-4b42-8946-507441b52d7b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:22.922025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0785898a-19c4-4b42-8946-507441b52d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:22.991123 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 919/1858] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:23.001898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:23.003442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:23.068921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a586307-5736-4037-9f98-d88789080f92 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:23.073338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644c19-61b9-4090-9c9b-4ceced272f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:23.073912 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644c19-61b9-4090-9c9b-4ceced272f38 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:23.074197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644c19-61b9-4090-9c9b-4ceced272f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:23.074495 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe644c19-61b9-4090-9c9b-4ceced272f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:23.083692 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644c19-61b9-4090-9c9b-4ceced272f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:23.115976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe644c19-61b9-4090-9c9b-4ceced272f38 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:23.126617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 940/1859] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:23 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:23.667989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785898a-19c4-4b42-8946-507441b52d7b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:23.668364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0785898a-19c4-4b42-8946-507441b52d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:23.688379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785898a-19c4-4b42-8946-507441b52d7b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:23.696237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:23.697506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:23.701850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:23.701850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] PATH_INFO: `/v3/projects/23b0b36d16724a9d880fc8366e9b855d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:23.701850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b0b36d16724a9d880fc8366e9b855d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:23.749568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:23.879220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b0b36d16724a9d880fc8366e9b855d', 'request_id': 'req-ed03d5b5-6818-47a1-961c-5c997d31f5bc'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:23.968864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b0b36d16724a9d880fc8366e9b855d', 'request_id': 'req-ed03d5b5-6818-47a1-961c-5c997d31f5bc'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:23.981594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b0b36d16724a9d880fc8366e9b855d', 'request_id': 'req-ed03d5b5-6818-47a1-961c-5c997d31f5bc'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:23.992375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] The token cache is being invalidate because project 23b0b36d16724a9d880fc8366e9b855d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:23.992652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:23.994001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:23.995526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 920/1860] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:23 2022] DELETE /identity/v3/projects/23b0b36d16724a9d880fc8366e9b855d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:23.999745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644c19-61b9-4090-9c9b-4ceced272f38 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:24.010809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe644c19-61b9-4090-9c9b-4ceced272f38 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:24.079798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:24.080714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:24.081108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:24.081285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] PATH_INFO: `/v3/users/f208b3b16a0042b59caeb8f1db1a5031` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:24.082419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f208b3b16a0042b59caeb8f1db1a5031)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:24.108701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:24.365037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f208b3b16a0042b59caeb8f1db1a5031'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:24.366611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f208b3b16a0042b59caeb8f1db1a5031'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:24.383818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f208b3b16a0042b59caeb8f1db1a5031'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:24.420974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f208b3b16a0042b59caeb8f1db1a5031'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:24.511910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-03338eeb-52ca-4f3c-bb60-d8133d370031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f208b3b16a0042b59caeb8f1db1a5031'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:24.518598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 941/1861] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:23 2022] DELETE /identity/v3/users/f208b3b16a0042b59caeb8f1db1a5031 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:25.076854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:25.079731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:25.102996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03d5b5-6818-47a1-961c-5c997d31f5bc admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:25.181624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:25.182450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:25.182731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:25.183023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] PATH_INFO: `/v3/projects/8000409c476945b7ab82aa67c49f8873` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:25.184158 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8000409c476945b7ab82aa67c49f8873)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:25.210611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:25.333918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8000409c476945b7ab82aa67c49f8873', 'request_id': 'req-e9b4aef9-77bd-46ff-9391-96475d54d271'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:25.432819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8000409c476945b7ab82aa67c49f8873', 'request_id': 'req-e9b4aef9-77bd-46ff-9391-96475d54d271'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:25.448253 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8000409c476945b7ab82aa67c49f8873', 'request_id': 'req-e9b4aef9-77bd-46ff-9391-96475d54d271'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:25.459023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] The token cache is being invalidate because project 8000409c476945b7ab82aa67c49f8873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:25.459297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:25.459950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9b4aef9-77bd-46ff-9391-96475d54d271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:25.461429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 921/1862] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:25 2022] DELETE /identity/v3/projects/8000409c476945b7ab82aa67c49f8873 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:25.467899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed91ba-dfa6-429e-b65c-a0f631521867 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:25.468389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed91ba-dfa6-429e-b65c-a0f631521867 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:25.468759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed91ba-dfa6-429e-b65c-a0f631521867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:25.497773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c9ed91ba-dfa6-429e-b65c-a0f631521867 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:25.499696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c9ed91ba-dfa6-429e-b65c-a0f631521867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:25.587399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 942/1863] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:25.589895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91088-b763-4e96-9ae3-aa14e73486fd None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:25.590251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91088-b763-4e96-9ae3-aa14e73486fd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:25.590650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91088-b763-4e96-9ae3-aa14e73486fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:25.625559 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-e3a91088-b763-4e96-9ae3-aa14e73486fd None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:25.627635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e3a91088-b763-4e96-9ae3-aa14e73486fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:25.644053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 922/1864] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:25 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:25.645040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed91ba-dfa6-429e-b65c-a0f631521867 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:25.658801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed91ba-dfa6-429e-b65c-a0f631521867 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:25.663939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa33cf-e3c1-489b-a750-812fc7829e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:25.669071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa33cf-e3c1-489b-a750-812fc7829e24 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:25.669071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa33cf-e3c1-489b-a750-812fc7829e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:25.669071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa33cf-e3c1-489b-a750-812fc7829e24 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:25.669071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa33cf-e3c1-489b-a750-812fc7829e24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:11:25.669071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa33cf-e3c1-489b-a750-812fc7829e24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:25.699026 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa33cf-e3c1-489b-a750-812fc7829e24 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:25.713368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 943/1865] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:11:25.717961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91088-b763-4e96-9ae3-aa14e73486fd None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:25.727593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91088-b763-4e96-9ae3-aa14e73486fd None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:25.732005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ab96c-eef3-4db9-b4ad-624bd61c9250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:25.732727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ab96c-eef3-4db9-b4ad-624bd61c9250 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:25.733252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ab96c-eef3-4db9-b4ad-624bd61c9250 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:25.733644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ab96c-eef3-4db9-b4ad-624bd61c9250 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:25.734340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ab96c-eef3-4db9-b4ad-624bd61c9250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:25.765268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ab96c-eef3-4db9-b4ad-624bd61c9250 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:25.928935 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 923/1866] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:25 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:25.932847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa33cf-e3c1-489b-a750-812fc7829e24 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:25.989764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa33cf-e3c1-489b-a750-812fc7829e24 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:26.054890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce916b1-9269-4471-9f1b-4e206665913a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:26.055556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce916b1-9269-4471-9f1b-4e206665913a admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:26.055855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce916b1-9269-4471-9f1b-4e206665913a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:26.056196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce916b1-9269-4471-9f1b-4e206665913a admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:26.056910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce916b1-9269-4471-9f1b-4e206665913a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:26.084444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce916b1-9269-4471-9f1b-4e206665913a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:26.216201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 944/1867] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:25 2022] POST /identity/v3/users => generated 289 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:26.220132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ab96c-eef3-4db9-b4ad-624bd61c9250 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:26.270255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ab96c-eef3-4db9-b4ad-624bd61c9250 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:26.280532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8e90e-ba7f-4f1a-bc98-7968011607f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:26.283204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8e90e-ba7f-4f1a-bc98-7968011607f5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:26.283204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8e90e-ba7f-4f1a-bc98-7968011607f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:26.283204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8e90e-ba7f-4f1a-bc98-7968011607f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:26.283204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8e90e-ba7f-4f1a-bc98-7968011607f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:26.309337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8e90e-ba7f-4f1a-bc98-7968011607f5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:26.320155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 924/1868] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:26.325061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce916b1-9269-4471-9f1b-4e206665913a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:26.334907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce916b1-9269-4471-9f1b-4e206665913a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:26.339700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f41c6-8f87-4301-93a1-e628d95e9edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:26.340767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f41c6-8f87-4301-93a1-e628d95e9edb admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:26.341057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f41c6-8f87-4301-93a1-e628d95e9edb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:26.341338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f41c6-8f87-4301-93a1-e628d95e9edb admin admin] PATH_INFO: `/v3/projects/e990b2d1eaf944659c3c24249653b91e/users/7cd48a3ad0684fd2973c619f8d3bb967/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:26.361564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f41c6-8f87-4301-93a1-e628d95e9edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e990b2d1eaf944659c3c24249653b91e, user_id=7cd48a3ad0684fd2973c619f8d3bb967, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:26.390319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f41c6-8f87-4301-93a1-e628d95e9edb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:26.493322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 945/1869] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:26 2022] PUT /identity/v3/projects/e990b2d1eaf944659c3c24249653b91e/users/7cd48a3ad0684fd2973c619f8d3bb967/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:26.503831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6d888-b39e-43ee-bbb1-0267f2da1432 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:26.504132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6d888-b39e-43ee-bbb1-0267f2da1432 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:26.504446 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6d888-b39e-43ee-bbb1-0267f2da1432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:26.544163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4ca6d888-b39e-43ee-bbb1-0267f2da1432 None None] MFA Rules not processed for user `7cd48a3ad0684fd2973c619f8d3bb967`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:26.545450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4ca6d888-b39e-43ee-bbb1-0267f2da1432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:26.625153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 925/1870] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:26 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:26.629674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f41c6-8f87-4301-93a1-e628d95e9edb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:26.710320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f41c6-8f87-4301-93a1-e628d95e9edb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:26.716733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18826117-8ce2-435a-b41c-600d4dcc2a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:26.717357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18826117-8ce2-435a-b41c-600d4dcc2a22 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:26.717843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18826117-8ce2-435a-b41c-600d4dcc2a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:26.718284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18826117-8ce2-435a-b41c-600d4dcc2a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:26.718942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18826117-8ce2-435a-b41c-600d4dcc2a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:26.745245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18826117-8ce2-435a-b41c-600d4dcc2a22 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:26.869853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6d888-b39e-43ee-bbb1-0267f2da1432 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:26.871558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 946/1871] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:26 2022] POST /identity/v3/projects => generated 379 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:26.884453 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6d888-b39e-43ee-bbb1-0267f2da1432 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:26.968502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577a1c7-f177-4abf-adc9-42b03eb04797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:26.969293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577a1c7-f177-4abf-adc9-42b03eb04797 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:26.969644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577a1c7-f177-4abf-adc9-42b03eb04797 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:26.969988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577a1c7-f177-4abf-adc9-42b03eb04797 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:26.970696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577a1c7-f177-4abf-adc9-42b03eb04797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:26.998409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577a1c7-f177-4abf-adc9-42b03eb04797 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:27.148319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 926/1872] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:26 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:27.152456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18826117-8ce2-435a-b41c-600d4dcc2a22 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:27.162730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18826117-8ce2-435a-b41c-600d4dcc2a22 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:27.167292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6f1b-10d4-4592-9cac-c8df1c7ab606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:27.167968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6f1b-10d4-4592-9cac-c8df1c7ab606 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:27.168250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6f1b-10d4-4592-9cac-c8df1c7ab606 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:27.169283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf6f1b-10d4-4592-9cac-c8df1c7ab606 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:27.169514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6f1b-10d4-4592-9cac-c8df1c7ab606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:27.196757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf6f1b-10d4-4592-9cac-c8df1c7ab606 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:27.211427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 947/1873] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:27.231123 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577a1c7-f177-4abf-adc9-42b03eb04797 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:27.242008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577a1c7-f177-4abf-adc9-42b03eb04797 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:27.247689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19ee5a-2e96-432d-a81a-73870755ece2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:27.248751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19ee5a-2e96-432d-a81a-73870755ece2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:27.249214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19ee5a-2e96-432d-a81a-73870755ece2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:27.249732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19ee5a-2e96-432d-a81a-73870755ece2 admin admin] PATH_INFO: `/v3/projects/21d88300d6784e98ab760c524d3d31b1/users/5e018ba69aa44ce39b09cd4ff32982db/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:27.274890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19ee5a-2e96-432d-a81a-73870755ece2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d88300d6784e98ab760c524d3d31b1, user_id=5e018ba69aa44ce39b09cd4ff32982db, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:27.306443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19ee5a-2e96-432d-a81a-73870755ece2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:27.314974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6f1b-10d4-4592-9cac-c8df1c7ab606 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:27.319099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-71bf6f1b-10d4-4592-9cac-c8df1c7ab606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:27.333287 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf6f1b-10d4-4592-9cac-c8df1c7ab606 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:27.339800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:27.339800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:27.339800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:27.340773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] PATH_INFO: `/v3/users/f50c4c1b68694d498f552abe1970fba6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:27.341625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50c4c1b68694d498f552abe1970fba6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:27.371054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:27.416166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 927/1874] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:27 2022] PUT /identity/v3/projects/21d88300d6784e98ab760c524d3d31b1/users/5e018ba69aa44ce39b09cd4ff32982db/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:27.428008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fff2-3a4e-4c59-aaa8-323e8d867328 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:27.428344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fff2-3a4e-4c59-aaa8-323e8d867328 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:27.428625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924fff2-3a4e-4c59-aaa8-323e8d867328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:27.482590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-8924fff2-3a4e-4c59-aaa8-323e8d867328 None None] MFA Rules not processed for user `5e018ba69aa44ce39b09cd4ff32982db`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:27.488630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8924fff2-3a4e-4c59-aaa8-323e8d867328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:27.585475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 928/1875] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:27.595762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924fff2-3a4e-4c59-aaa8-323e8d867328 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:27.679817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50c4c1b68694d498f552abe1970fba6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:27.681394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50c4c1b68694d498f552abe1970fba6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:27.693915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50c4c1b68694d498f552abe1970fba6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:27.716138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50c4c1b68694d498f552abe1970fba6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:27.723198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924fff2-3a4e-4c59-aaa8-323e8d867328 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:27.738589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045385f-6815-436e-a08c-8f0c13f451ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:27.739898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045385f-6815-436e-a08c-8f0c13f451ed admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:27.741162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045385f-6815-436e-a08c-8f0c13f451ed admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:27.741162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045385f-6815-436e-a08c-8f0c13f451ed admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:27.741980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045385f-6815-436e-a08c-8f0c13f451ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:27.779003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045385f-6815-436e-a08c-8f0c13f451ed admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:27.815127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-17b26552-5f9a-4198-bdc4-b4b5a90aba3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50c4c1b68694d498f552abe1970fba6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:27.822018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 948/1876] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:27 2022] DELETE /identity/v3/users/f50c4c1b68694d498f552abe1970fba6 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:27.827218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658f7a0-fb67-40c4-91e9-4a8fd9ac07ff None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:27.827551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658f7a0-fb67-40c4-91e9-4a8fd9ac07ff None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:27.827771 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658f7a0-fb67-40c4-91e9-4a8fd9ac07ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:27.866892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a658f7a0-fb67-40c4-91e9-4a8fd9ac07ff None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:27.868124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a658f7a0-fb67-40c4-91e9-4a8fd9ac07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:27.963689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 929/1877] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:27 2022] POST /identity/v3/projects => generated 375 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:27.968765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045385f-6815-436e-a08c-8f0c13f451ed admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:27.971767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7045385f-6815-436e-a08c-8f0c13f451ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:27.990017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 949/1878] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:28.003915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658f7a0-fb67-40c4-91e9-4a8fd9ac07ff None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:28.005361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a658f7a0-fb67-40c4-91e9-4a8fd9ac07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:28.072533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045385f-6815-436e-a08c-8f0c13f451ed admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:28.081191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81737c8-2736-41d7-85d9-c73a7764dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:28.091358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81737c8-2736-41d7-85d9-c73a7764dd9b admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:28.091358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81737c8-2736-41d7-85d9-c73a7764dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:28.091358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81737c8-2736-41d7-85d9-c73a7764dd9b admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:28.091358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81737c8-2736-41d7-85d9-c73a7764dd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:28.158935 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81737c8-2736-41d7-85d9-c73a7764dd9b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:28.180888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658f7a0-fb67-40c4-91e9-4a8fd9ac07ff None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:28.242336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11238f-d0b1-4f5c-b17e-83d7869a3d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:28.242944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11238f-d0b1-4f5c-b17e-83d7869a3d80 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:28.243236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11238f-d0b1-4f5c-b17e-83d7869a3d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:28.243546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11238f-d0b1-4f5c-b17e-83d7869a3d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:28.254482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11238f-d0b1-4f5c-b17e-83d7869a3d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:28.258043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 930/1879] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:27 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:28.262598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81737c8-2736-41d7-85d9-c73a7764dd9b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:28.273797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81737c8-2736-41d7-85d9-c73a7764dd9b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:28.281084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ab7b4-6fcb-41f6-a622-231a547bb29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:28.286400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ab7b4-6fcb-41f6-a622-231a547bb29a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:28.286400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ab7b4-6fcb-41f6-a622-231a547bb29a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:28.286400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ab7b4-6fcb-41f6-a622-231a547bb29a admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:28.286400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ab7b4-6fcb-41f6-a622-231a547bb29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:28.289466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11238f-d0b1-4f5c-b17e-83d7869a3d80 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:28.301371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 950/1880] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:28 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:28.324231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ab7b4-6fcb-41f6-a622-231a547bb29a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:28.336350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 931/1881] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:28.340705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11238f-d0b1-4f5c-b17e-83d7869a3d80 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:28.350343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11238f-d0b1-4f5c-b17e-83d7869a3d80 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:28.355257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220e1fa-f867-40bc-aec0-9e7277d24d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:28.356128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220e1fa-f867-40bc-aec0-9e7277d24d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:28.356417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220e1fa-f867-40bc-aec0-9e7277d24d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:28.356701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220e1fa-f867-40bc-aec0-9e7277d24d9c admin admin] PATH_INFO: `/v3/projects/04c80cf7d8844e74aaa468ce1690616d/users/5173950662cf45b5be7bad37ff033c8c/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:28.378966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220e1fa-f867-40bc-aec0-9e7277d24d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c80cf7d8844e74aaa468ce1690616d, user_id=5173950662cf45b5be7bad37ff033c8c, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:28.407966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f220e1fa-f867-40bc-aec0-9e7277d24d9c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:28.507248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 951/1882] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:28 2022] PUT /identity/v3/projects/04c80cf7d8844e74aaa468ce1690616d/users/5173950662cf45b5be7bad37ff033c8c/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:28.512140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ab7b4-6fcb-41f6-a622-231a547bb29a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:28.521934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ab7b4-6fcb-41f6-a622-231a547bb29a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:28.603631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b6bf6-ee30-476b-a252-cfd41ffaa640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:28.605010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b6bf6-ee30-476b-a252-cfd41ffaa640 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:28.605786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b6bf6-ee30-476b-a252-cfd41ffaa640 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:28.606087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b6bf6-ee30-476b-a252-cfd41ffaa640 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:28.607389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b6bf6-ee30-476b-a252-cfd41ffaa640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:28.650775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b6bf6-ee30-476b-a252-cfd41ffaa640 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:28.663380 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 932/1883] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:28.668005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220e1fa-f867-40bc-aec0-9e7277d24d9c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:28.678126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220e1fa-f867-40bc-aec0-9e7277d24d9c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:28.682494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed605bb4-1882-4db1-afcf-34c940953825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:28.683385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed605bb4-1882-4db1-afcf-34c940953825 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:28.683929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed605bb4-1882-4db1-afcf-34c940953825 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:28.684213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed605bb4-1882-4db1-afcf-34c940953825 admin admin] PATH_INFO: `/v3/projects/04c80cf7d8844e74aaa468ce1690616d/users/5173950662cf45b5be7bad37ff033c8c/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:28.685990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed605bb4-1882-4db1-afcf-34c940953825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c80cf7d8844e74aaa468ce1690616d, user_id=5173950662cf45b5be7bad37ff033c8c, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:28.712586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed605bb4-1882-4db1-afcf-34c940953825 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:28.724477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 952/1884] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:28 2022] PUT /identity/v3/projects/04c80cf7d8844e74aaa468ce1690616d/users/5173950662cf45b5be7bad37ff033c8c/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:28.728413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b6bf6-ee30-476b-a252-cfd41ffaa640 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:28.738688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b6bf6-ee30-476b-a252-cfd41ffaa640 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:28.825493 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bb20e-0b89-4a1a-895a-4997baf333dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:28.826102 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bb20e-0b89-4a1a-895a-4997baf333dc admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:28.826389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bb20e-0b89-4a1a-895a-4997baf333dc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:28.826678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bb20e-0b89-4a1a-895a-4997baf333dc admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:28.827464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bb20e-0b89-4a1a-895a-4997baf333dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:28.856584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bb20e-0b89-4a1a-895a-4997baf333dc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:28.871728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 933/1885] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:28.872561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed605bb4-1882-4db1-afcf-34c940953825 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:28.882816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed605bb4-1882-4db1-afcf-34c940953825 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:28.888247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de1d8b-3a3f-4324-af23-bb3fc4680988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:28.889153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de1d8b-3a3f-4324-af23-bb3fc4680988 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:28.889510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de1d8b-3a3f-4324-af23-bb3fc4680988 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:28.889852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de1d8b-3a3f-4324-af23-bb3fc4680988 admin admin] PATH_INFO: `/v3/projects/04c80cf7d8844e74aaa468ce1690616d/users/5173950662cf45b5be7bad37ff033c8c/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:28.891877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de1d8b-3a3f-4324-af23-bb3fc4680988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c80cf7d8844e74aaa468ce1690616d, user_id=5173950662cf45b5be7bad37ff033c8c, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:28.926680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de1d8b-3a3f-4324-af23-bb3fc4680988 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:28.947347 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bb20e-0b89-4a1a-895a-4997baf333dc admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:28.949703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4e3bb20e-0b89-4a1a-895a-4997baf333dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:28.979421 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bb20e-0b89-4a1a-895a-4997baf333dc admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:28.986930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:28.987773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:28.988060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:28.988341 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] PATH_INFO: `/v3/projects/fc47a08d2e7f4926bd2cd7625db83522` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:28.997884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc47a08d2e7f4926bd2cd7625db83522)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:29.025425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:29.048317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 953/1886] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:28 2022] PUT /identity/v3/projects/04c80cf7d8844e74aaa468ce1690616d/users/5173950662cf45b5be7bad37ff033c8c/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:29.057700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7298c32-fba3-4535-914b-be474fde0f74 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:29.058611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7298c32-fba3-4535-914b-be474fde0f74 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:29.058899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7298c32-fba3-4535-914b-be474fde0f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:29.115607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d7298c32-fba3-4535-914b-be474fde0f74 None None] MFA Rules not processed for user `5173950662cf45b5be7bad37ff033c8c`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:29.117216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d7298c32-fba3-4535-914b-be474fde0f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:29.222727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc47a08d2e7f4926bd2cd7625db83522', 'request_id': 'req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:29.240588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 954/1887] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:29.252399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7298c32-fba3-4535-914b-be474fde0f74 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:29.252949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d7298c32-fba3-4535-914b-be474fde0f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:29.306165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc47a08d2e7f4926bd2cd7625db83522', 'request_id': 'req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:29.319064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc47a08d2e7f4926bd2cd7625db83522', 'request_id': 'req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:29.321735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7298c32-fba3-4535-914b-be474fde0f74 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:29.331671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] The token cache is being invalidate because project fc47a08d2e7f4926bd2cd7625db83522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:29.331942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:29.332628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-19591f96-0a0f-4c47-aa8c-c6a7b714cb78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:29.334291 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 934/1888] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:28 2022] DELETE /identity/v3/projects/fc47a08d2e7f4926bd2cd7625db83522 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:29.340217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584af129-1dae-48c6-b214-f4a23072efdd None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:29.340521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584af129-1dae-48c6-b214-f4a23072efdd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:29.340814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584af129-1dae-48c6-b214-f4a23072efdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:29.382354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579ff50-ce8c-434e-8948-57a137f7ed4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:29.382988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579ff50-ce8c-434e-8948-57a137f7ed4b service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:29.383279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579ff50-ce8c-434e-8948-57a137f7ed4b service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:29.383620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c579ff50-ce8c-434e-8948-57a137f7ed4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:29.385299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c579ff50-ce8c-434e-8948-57a137f7ed4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:29.391856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-584af129-1dae-48c6-b214-f4a23072efdd None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:29.392993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-584af129-1dae-48c6-b214-f4a23072efdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:29.456147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579ff50-ce8c-434e-8948-57a137f7ed4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:29.466342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 935/1889] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:29.467720 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2440ed-af3d-44c1-9998-d9e581aa3d6c None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:29.468016 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2440ed-af3d-44c1-9998-d9e581aa3d6c None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:29.471149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2440ed-af3d-44c1-9998-d9e581aa3d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:29.488538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c579ff50-ce8c-434e-8948-57a137f7ed4b service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:29.494571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-bf2440ed-af3d-44c1-9998-d9e581aa3d6c None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:29.496407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bf2440ed-af3d-44c1-9998-d9e581aa3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:29.499947 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 955/1890] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3749 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:11:29.508068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 936/1891] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:29 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:29.513834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579ff50-ce8c-434e-8948-57a137f7ed4b service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:29.524004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c579ff50-ce8c-434e-8948-57a137f7ed4b service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:29.529601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:29.530207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:29.530498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:29.530784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:29.531654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:11:29.531974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:29.560405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:29.575226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 956/1892] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:11:29.579679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2440ed-af3d-44c1-9998-d9e581aa3d6c None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:29.588562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2440ed-af3d-44c1-9998-d9e581aa3d6c None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:29.594067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592eefe-f7f0-4128-8a0d-f07ab49fec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:29.594723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592eefe-f7f0-4128-8a0d-f07ab49fec94 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:29.595083 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592eefe-f7f0-4128-8a0d-f07ab49fec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:29.595488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a592eefe-f7f0-4128-8a0d-f07ab49fec94 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:29.596288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592eefe-f7f0-4128-8a0d-f07ab49fec94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:29.623684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a592eefe-f7f0-4128-8a0d-f07ab49fec94 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:29.624465 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:29.626269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:29.639182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d78a2-528b-4912-b9c4-4a9a87467520 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:29.642768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:29.643807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:29.643807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:29.644027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:29.645629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:29.718276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:29.744443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:29.753712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 957/1893] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:29 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:29.754559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:29.755774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:29.769839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b197a9a-4e8c-4eff-94a4-73b099a78a15 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:29.771728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 937/1894] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:29 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:29.775549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592eefe-f7f0-4128-8a0d-f07ab49fec94 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:29.860654 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a592eefe-f7f0-4128-8a0d-f07ab49fec94 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:29.865277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fc04d-d429-4266-8ee4-f94bc4605916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:29.865909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fc04d-d429-4266-8ee4-f94bc4605916 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:29.866200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fc04d-d429-4266-8ee4-f94bc4605916 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:29.866486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fc04d-d429-4266-8ee4-f94bc4605916 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:29.867137 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fc04d-d429-4266-8ee4-f94bc4605916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:29.896472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fc04d-d429-4266-8ee4-f94bc4605916 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:29.921011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:29.921812 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:29.922103 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:29.922385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] PATH_INFO: `/v3/users/0c4934cbef324f618f6c59b9af30a02b` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:29.923630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4934cbef324f618f6c59b9af30a02b)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:29.950506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:30.021341 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 938/1895] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:29 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:30.025249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fc04d-d429-4266-8ee4-f94bc4605916 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:30.035504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fc04d-d429-4266-8ee4-f94bc4605916 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:30.039870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccfe46-4244-412e-91bc-03cce788b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:30.040466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccfe46-4244-412e-91bc-03cce788b925 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:30.040757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccfe46-4244-412e-91bc-03cce788b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:30.041037 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccfe46-4244-412e-91bc-03cce788b925 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:30.041733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccfe46-4244-412e-91bc-03cce788b925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:30.068091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccfe46-4244-412e-91bc-03cce788b925 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:30.079137 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 939/1896] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:11:30.083152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccfe46-4244-412e-91bc-03cce788b925 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:30.095695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccfe46-4244-412e-91bc-03cce788b925 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:30.101468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14faead-108a-4dd1-83a2-90e721c34b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:30.102312 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14faead-108a-4dd1-83a2-90e721c34b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:30.102585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14faead-108a-4dd1-83a2-90e721c34b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:30.102989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14faead-108a-4dd1-83a2-90e721c34b04 admin admin] PATH_INFO: `/v3/projects/b88e370b93ef4ee3acbeb5ee4a88abb5/users/3d7234bba23e406db45a253267b5502f/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:30.129626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14faead-108a-4dd1-83a2-90e721c34b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88e370b93ef4ee3acbeb5ee4a88abb5, user_id=3d7234bba23e406db45a253267b5502f, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:30.154923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14faead-108a-4dd1-83a2-90e721c34b04 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:30.216425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4934cbef324f618f6c59b9af30a02b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:30.217039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4934cbef324f618f6c59b9af30a02b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:30.224591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4934cbef324f618f6c59b9af30a02b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:30.236611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4934cbef324f618f6c59b9af30a02b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:30.283517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 940/1897] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:30 2022] PUT /identity/v3/projects/b88e370b93ef4ee3acbeb5ee4a88abb5/users/3d7234bba23e406db45a253267b5502f/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:30.293882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af353-abb7-410c-a2bc-3abdd3c94543 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:30.294166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af353-abb7-410c-a2bc-3abdd3c94543 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:30.294445 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af353-abb7-410c-a2bc-3abdd3c94543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:30.341120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-033af353-abb7-410c-a2bc-3abdd3c94543 None None] MFA Rules not processed for user `3d7234bba23e406db45a253267b5502f`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:30.342259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-033af353-abb7-410c-a2bc-3abdd3c94543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:30.344366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-844ca936-dc77-40e7-bbde-28cd39596214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4934cbef324f618f6c59b9af30a02b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:30.350903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 958/1898] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:29 2022] DELETE /identity/v3/users/0c4934cbef324f618f6c59b9af30a02b => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:30.356226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91503e62-007b-4c06-b7e2-98b633de3298 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:30.356518 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91503e62-007b-4c06-b7e2-98b633de3298 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:30.356802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91503e62-007b-4c06-b7e2-98b633de3298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:30.380033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-91503e62-007b-4c06-b7e2-98b633de3298 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:30.381357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-91503e62-007b-4c06-b7e2-98b633de3298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:30.419863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 941/1899] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:30.430604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af353-abb7-410c-a2bc-3abdd3c94543 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:30.431999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-033af353-abb7-410c-a2bc-3abdd3c94543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:30.453639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 959/1900] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:30.472042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91503e62-007b-4c06-b7e2-98b633de3298 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:30.473345 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-91503e62-007b-4c06-b7e2-98b633de3298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:30.503213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af353-abb7-410c-a2bc-3abdd3c94543 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:30.542869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91503e62-007b-4c06-b7e2-98b633de3298 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:30.546218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f08df0-f9a9-4adb-9851-b99fcb870e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:30.546809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f08df0-f9a9-4adb-9851-b99fcb870e71 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:30.547079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f08df0-f9a9-4adb-9851-b99fcb870e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:30.547421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f08df0-f9a9-4adb-9851-b99fcb870e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:30.557067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f08df0-f9a9-4adb-9851-b99fcb870e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:30.567275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55134e5f-59d4-4e63-928b-70b04ceb5909 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aecbdda2f524fbca580d99b3001bed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:30.567891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55134e5f-59d4-4e63-928b-70b04ceb5909 service glance] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:30.568182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55134e5f-59d4-4e63-928b-70b04ceb5909 service glance] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:30.568747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55134e5f-59d4-4e63-928b-70b04ceb5909 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:30.583746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f08df0-f9a9-4adb-9851-b99fcb870e71 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:30.594193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 960/1901] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:30 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:11:30.635868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55134e5f-59d4-4e63-928b-70b04ceb5909 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:30.663156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55134e5f-59d4-4e63-928b-70b04ceb5909 service glance] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:30.673354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 942/1902] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:30 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:31.240760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f08df0-f9a9-4adb-9851-b99fcb870e71 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:31.242768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b6f08df0-f9a9-4adb-9851-b99fcb870e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:31.256721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f08df0-f9a9-4adb-9851-b99fcb870e71 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:31.261410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:31.262457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:31.263099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:31.263663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] PATH_INFO: `/v3/projects/565a36d9284a4a8e8eea0bbf0a1a0111` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:31.264850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565a36d9284a4a8e8eea0bbf0a1a0111)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:31.291457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:31.448661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565a36d9284a4a8e8eea0bbf0a1a0111', 'request_id': 'req-273e78fd-0db4-462e-9ffc-3f1f655faeb4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:31.527528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565a36d9284a4a8e8eea0bbf0a1a0111', 'request_id': 'req-273e78fd-0db4-462e-9ffc-3f1f655faeb4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:31.539657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565a36d9284a4a8e8eea0bbf0a1a0111', 'request_id': 'req-273e78fd-0db4-462e-9ffc-3f1f655faeb4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:31.551720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] The token cache is being invalidate because project 565a36d9284a4a8e8eea0bbf0a1a0111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:31.552002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:31.552617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:31.554028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 961/1903] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:31 2022] DELETE /identity/v3/projects/565a36d9284a4a8e8eea0bbf0a1a0111 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:31.558030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55134e5f-59d4-4e63-928b-70b04ceb5909 service glance] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:31.569081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55134e5f-59d4-4e63-928b-70b04ceb5909 service glance] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:31.635970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:31.637761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:31.638152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:31.638440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] PATH_INFO: `/v3/users/fb6a3b4d320a42acae8883adedbcd015` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:31.639605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6a3b4d320a42acae8883adedbcd015)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:31.665871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:31.941692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6a3b4d320a42acae8883adedbcd015'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:31.954275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6a3b4d320a42acae8883adedbcd015'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:31.954887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6a3b4d320a42acae8883adedbcd015'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:31.962464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6a3b4d320a42acae8883adedbcd015'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:32.087576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-84519c37-a1c4-44ef-9ac3-853537b141a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6a3b4d320a42acae8883adedbcd015'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:32.094866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 943/1904] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:31 2022] DELETE /identity/v3/users/fb6a3b4d320a42acae8883adedbcd015 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:32.680449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:32.681819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:32.694434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e78fd-0db4-462e-9ffc-3f1f655faeb4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:32.763739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:32.764179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:32.764473 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:32.764761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] PATH_INFO: `/v3/projects/71f21770f652420f98cb8eed13d2db92` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:32.765923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f21770f652420f98cb8eed13d2db92)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:32.795749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:32.948532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f21770f652420f98cb8eed13d2db92', 'request_id': 'req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:33.061865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f21770f652420f98cb8eed13d2db92', 'request_id': 'req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:33.079007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f21770f652420f98cb8eed13d2db92', 'request_id': 'req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:33.090078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] The token cache is being invalidate because project 71f21770f652420f98cb8eed13d2db92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:33.090392 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:33.091019 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1df2c1c3-4f13-44ce-b999-b6ecdd00d32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:33.092784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 962/1905] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:32 2022] DELETE /identity/v3/projects/71f21770f652420f98cb8eed13d2db92 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:33.100308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f21d4-6c1c-4b55-8f3a-e2ce3e0931c7 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:33.100818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f21d4-6c1c-4b55-8f3a-e2ce3e0931c7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:33.106831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f21d4-6c1c-4b55-8f3a-e2ce3e0931c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:33.124861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-cf7f21d4-6c1c-4b55-8f3a-e2ce3e0931c7 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:33.126004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-cf7f21d4-6c1c-4b55-8f3a-e2ce3e0931c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:33.193155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 944/1906] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:33.202566 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e375bc-caaa-4b90-a8cb-c89d964264e8 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:33.202899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e375bc-caaa-4b90-a8cb-c89d964264e8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:33.203186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e375bc-caaa-4b90-a8cb-c89d964264e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:33.226354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-25e375bc-caaa-4b90-a8cb-c89d964264e8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:33.227708 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-25e375bc-caaa-4b90-a8cb-c89d964264e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:33.235621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 963/1907] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:33.240064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f21d4-6c1c-4b55-8f3a-e2ce3e0931c7 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:33.249628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f21d4-6c1c-4b55-8f3a-e2ce3e0931c7 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:33.253928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa28886-f6ad-48a6-9931-79a0a3b17e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:33.254518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa28886-f6ad-48a6-9931-79a0a3b17e36 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:33.254803 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa28886-f6ad-48a6-9931-79a0a3b17e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:33.255080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa28886-f6ad-48a6-9931-79a0a3b17e36 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:33.255799 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa28886-f6ad-48a6-9931-79a0a3b17e36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:11:33.256097 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa28886-f6ad-48a6-9931-79a0a3b17e36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:33.283393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa28886-f6ad-48a6-9931-79a0a3b17e36 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:33.297248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 945/1908] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:11:33.301345 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e375bc-caaa-4b90-a8cb-c89d964264e8 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:33.311027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e375bc-caaa-4b90-a8cb-c89d964264e8 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:33.315601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd15e7-157a-4434-a1fb-2f50fc7e7c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:33.316301 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd15e7-157a-4434-a1fb-2f50fc7e7c85 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:33.316588 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd15e7-157a-4434-a1fb-2f50fc7e7c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:33.316865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd15e7-157a-4434-a1fb-2f50fc7e7c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:33.317499 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd15e7-157a-4434-a1fb-2f50fc7e7c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:33.345561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd15e7-157a-4434-a1fb-2f50fc7e7c85 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:33.425792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 964/1909] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:33 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:33.430853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa28886-f6ad-48a6-9931-79a0a3b17e36 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:33.441359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa28886-f6ad-48a6-9931-79a0a3b17e36 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:33.508595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1bbfa-a2f2-49ba-9f67-c39088185356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:33.509209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1bbfa-a2f2-49ba-9f67-c39088185356 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:33.509496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1bbfa-a2f2-49ba-9f67-c39088185356 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:33.509778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1bbfa-a2f2-49ba-9f67-c39088185356 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:33.510413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1bbfa-a2f2-49ba-9f67-c39088185356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:33.536777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1bbfa-a2f2-49ba-9f67-c39088185356 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:33.681523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 946/1910] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:33 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:33.685834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd15e7-157a-4434-a1fb-2f50fc7e7c85 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:33.695745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd15e7-157a-4434-a1fb-2f50fc7e7c85 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:33.700156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c1149-6dc7-4a98-a12f-7ffa823f0e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:33.700779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c1149-6dc7-4a98-a12f-7ffa823f0e9b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:33.701064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c1149-6dc7-4a98-a12f-7ffa823f0e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:33.701345 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c1149-6dc7-4a98-a12f-7ffa823f0e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:33.702033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c1149-6dc7-4a98-a12f-7ffa823f0e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:33.728600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c1149-6dc7-4a98-a12f-7ffa823f0e9b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:33.739429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 965/1911] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:11:33.743495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1bbfa-a2f2-49ba-9f67-c39088185356 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:33.754590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1bbfa-a2f2-49ba-9f67-c39088185356 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:33.759704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c27b0a-6283-4d4c-92f6-ae17db50b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:33.760703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27b0a-6283-4d4c-92f6-ae17db50b2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:33.760998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27b0a-6283-4d4c-92f6-ae17db50b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:33.761468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c27b0a-6283-4d4c-92f6-ae17db50b2ca admin admin] PATH_INFO: `/v3/projects/8ea1e91bd9e945aa84db3aaddc86540f/users/e1b04ad91baa4396893714752968ddb4/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:33.785710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c27b0a-6283-4d4c-92f6-ae17db50b2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea1e91bd9e945aa84db3aaddc86540f, user_id=e1b04ad91baa4396893714752968ddb4, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:33.812586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c27b0a-6283-4d4c-92f6-ae17db50b2ca admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:33.985008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 947/1912] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:33 2022] PUT /identity/v3/projects/8ea1e91bd9e945aa84db3aaddc86540f/users/e1b04ad91baa4396893714752968ddb4/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:34.001479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa66af-74fb-4d83-b2ea-98b48fb962ce None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:34.002393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa66af-74fb-4d83-b2ea-98b48fb962ce None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:34.002393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa66af-74fb-4d83-b2ea-98b48fb962ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:34.041322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7baa66af-74fb-4d83-b2ea-98b48fb962ce None None] MFA Rules not processed for user `e1b04ad91baa4396893714752968ddb4`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:34.042483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7baa66af-74fb-4d83-b2ea-98b48fb962ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:34.158888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 966/1913] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:33 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:34.163473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c27b0a-6283-4d4c-92f6-ae17db50b2ca admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:34.246209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c27b0a-6283-4d4c-92f6-ae17db50b2ca admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:34.250714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc430707-b615-417d-b64b-9b62d4494e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:34.251332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc430707-b615-417d-b64b-9b62d4494e9e admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:34.251627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc430707-b615-417d-b64b-9b62d4494e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:34.251908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc430707-b615-417d-b64b-9b62d4494e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:34.252560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc430707-b615-417d-b64b-9b62d4494e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:34.282941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc430707-b615-417d-b64b-9b62d4494e9e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:34.413412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 948/1914] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:34 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:34.416266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa66af-74fb-4d83-b2ea-98b48fb962ce None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:34.428357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa66af-74fb-4d83-b2ea-98b48fb962ce None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:34.508292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90080e08-2063-4f37-881f-0338a58d8589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:34.508901 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90080e08-2063-4f37-881f-0338a58d8589 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:34.509312 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90080e08-2063-4f37-881f-0338a58d8589 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:34.509658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90080e08-2063-4f37-881f-0338a58d8589 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:34.510390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90080e08-2063-4f37-881f-0338a58d8589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:34.540879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90080e08-2063-4f37-881f-0338a58d8589 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:34.661642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 967/1915] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:34 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:34.667204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc430707-b615-417d-b64b-9b62d4494e9e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:34.678030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc430707-b615-417d-b64b-9b62d4494e9e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:34.682483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d6915-4f11-473e-95ec-b005f11e88d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:34.683144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d6915-4f11-473e-95ec-b005f11e88d2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:34.683467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d6915-4f11-473e-95ec-b005f11e88d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:34.683754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d6915-4f11-473e-95ec-b005f11e88d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:34.684810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d6915-4f11-473e-95ec-b005f11e88d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:34.710984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d6915-4f11-473e-95ec-b005f11e88d2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:34.723778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 949/1916] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:34.728106 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90080e08-2063-4f37-881f-0338a58d8589 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:34.737896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90080e08-2063-4f37-881f-0338a58d8589 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:34.742189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf505a71-c439-4a0a-baa3-4d43ed2d9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:34.742995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf505a71-c439-4a0a-baa3-4d43ed2d9c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:34.743284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf505a71-c439-4a0a-baa3-4d43ed2d9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:34.743600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf505a71-c439-4a0a-baa3-4d43ed2d9c20 admin admin] PATH_INFO: `/v3/projects/9e4dff800c264fce8892758d8df6ba06/users/39d531a5895547f4bd093d84e7aa069d/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:34.766381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf505a71-c439-4a0a-baa3-4d43ed2d9c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4dff800c264fce8892758d8df6ba06, user_id=39d531a5895547f4bd093d84e7aa069d, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:34.800826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf505a71-c439-4a0a-baa3-4d43ed2d9c20 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:34.917756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 968/1917] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:34 2022] PUT /identity/v3/projects/9e4dff800c264fce8892758d8df6ba06/users/39d531a5895547f4bd093d84e7aa069d/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:34.925435 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d6915-4f11-473e-95ec-b005f11e88d2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:34.935898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d6915-4f11-473e-95ec-b005f11e88d2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:35.016483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cf096-78b3-44fe-98f1-291ac33dc43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:35.017087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cf096-78b3-44fe-98f1-291ac33dc43b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:35.017371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cf096-78b3-44fe-98f1-291ac33dc43b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:35.017648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cf096-78b3-44fe-98f1-291ac33dc43b admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:35.018376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cf096-78b3-44fe-98f1-291ac33dc43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:35.046157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cf096-78b3-44fe-98f1-291ac33dc43b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:35.063675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 950/1918] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:35.067665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf505a71-c439-4a0a-baa3-4d43ed2d9c20 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:35.080470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf505a71-c439-4a0a-baa3-4d43ed2d9c20 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:35.085513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce053-13ac-4abd-ae50-0addf975e214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:35.090715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce053-13ac-4abd-ae50-0addf975e214 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:35.090715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce053-13ac-4abd-ae50-0addf975e214 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:35.090715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ce053-13ac-4abd-ae50-0addf975e214 admin admin] PATH_INFO: `/v3/projects/9e4dff800c264fce8892758d8df6ba06/users/39d531a5895547f4bd093d84e7aa069d/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:35.090715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ce053-13ac-4abd-ae50-0addf975e214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4dff800c264fce8892758d8df6ba06, user_id=39d531a5895547f4bd093d84e7aa069d, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:35.118335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ce053-13ac-4abd-ae50-0addf975e214 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:35.130213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 969/1919] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:35 2022] PUT /identity/v3/projects/9e4dff800c264fce8892758d8df6ba06/users/39d531a5895547f4bd093d84e7aa069d/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:35.133937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cf096-78b3-44fe-98f1-291ac33dc43b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:35.145212 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cf096-78b3-44fe-98f1-291ac33dc43b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:35.214567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99e64d-799c-4abf-8188-ac5a1d991257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:35.216019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e64d-799c-4abf-8188-ac5a1d991257 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:35.216309 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e64d-799c-4abf-8188-ac5a1d991257 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:35.216764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99e64d-799c-4abf-8188-ac5a1d991257 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:35.217489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99e64d-799c-4abf-8188-ac5a1d991257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:35.250346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99e64d-799c-4abf-8188-ac5a1d991257 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:35.260871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 951/1920] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:35.266068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce053-13ac-4abd-ae50-0addf975e214 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:35.284375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ce053-13ac-4abd-ae50-0addf975e214 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:35.291248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c27a3-1e19-4ada-97de-8d0651f93326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:35.292652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c27a3-1e19-4ada-97de-8d0651f93326 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:35.293258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c27a3-1e19-4ada-97de-8d0651f93326 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:35.294230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c27a3-1e19-4ada-97de-8d0651f93326 admin admin] PATH_INFO: `/v3/projects/9e4dff800c264fce8892758d8df6ba06/users/39d531a5895547f4bd093d84e7aa069d/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:35.297067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c27a3-1e19-4ada-97de-8d0651f93326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4dff800c264fce8892758d8df6ba06, user_id=39d531a5895547f4bd093d84e7aa069d, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:35.354697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c27a3-1e19-4ada-97de-8d0651f93326 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:35.443234 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 970/1921] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:35 2022] PUT /identity/v3/projects/9e4dff800c264fce8892758d8df6ba06/users/39d531a5895547f4bd093d84e7aa069d/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:35.455632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713500b-24f4-46b0-8e69-657f2790a2c0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:35.456241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713500b-24f4-46b0-8e69-657f2790a2c0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:35.456495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713500b-24f4-46b0-8e69-657f2790a2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:35.494290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-5713500b-24f4-46b0-8e69-657f2790a2c0 None None] MFA Rules not processed for user `39d531a5895547f4bd093d84e7aa069d`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:35.495498 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5713500b-24f4-46b0-8e69-657f2790a2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:35.591792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 952/1922] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:35 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:35.622952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c27a3-1e19-4ada-97de-8d0651f93326 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:35.624858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-440c27a3-1e19-4ada-97de-8d0651f93326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:35.719174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c27a3-1e19-4ada-97de-8d0651f93326 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:35.722539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cde7fd-2c41-456e-8ffb-cb2c37101340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:35.723111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cde7fd-2c41-456e-8ffb-cb2c37101340 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:35.723426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cde7fd-2c41-456e-8ffb-cb2c37101340 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:35.723707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cde7fd-2c41-456e-8ffb-cb2c37101340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:35.734011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cde7fd-2c41-456e-8ffb-cb2c37101340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:35.760649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cde7fd-2c41-456e-8ffb-cb2c37101340 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:35.773694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 971/1923] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:35 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:35.885294 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713500b-24f4-46b0-8e69-657f2790a2c0 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:35.897506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713500b-24f4-46b0-8e69-657f2790a2c0 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:35.902217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418fc47-1f7e-462c-a31b-bcf1ee78c0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:35.904527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418fc47-1f7e-462c-a31b-bcf1ee78c0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:35.904903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418fc47-1f7e-462c-a31b-bcf1ee78c0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:35.905330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b418fc47-1f7e-462c-a31b-bcf1ee78c0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:35.990905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418fc47-1f7e-462c-a31b-bcf1ee78c0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:36.021063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b418fc47-1f7e-462c-a31b-bcf1ee78c0b8 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:36.031540 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 953/1924] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:35 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:36.999603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cde7fd-2c41-456e-8ffb-cb2c37101340 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:37.001734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e5cde7fd-2c41-456e-8ffb-cb2c37101340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:37.103899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cde7fd-2c41-456e-8ffb-cb2c37101340 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:37.116049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:37.116883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:37.117176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:37.117686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] PATH_INFO: `/v3/users/33eabb14bdfd4a70b52101bd2333dc48` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:37.119042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33eabb14bdfd4a70b52101bd2333dc48)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:37.146693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:37.365195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33eabb14bdfd4a70b52101bd2333dc48'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:37.365990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33eabb14bdfd4a70b52101bd2333dc48'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:37.374269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33eabb14bdfd4a70b52101bd2333dc48'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:37.386119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33eabb14bdfd4a70b52101bd2333dc48'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:37.500594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-85ece190-227f-453e-b22c-fe59408dab59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33eabb14bdfd4a70b52101bd2333dc48'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:37.512663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 972/1925] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:36 2022] DELETE /identity/v3/users/33eabb14bdfd4a70b52101bd2333dc48 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:37.944213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418fc47-1f7e-462c-a31b-bcf1ee78c0b8 service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:37.955235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b418fc47-1f7e-462c-a31b-bcf1ee78c0b8 service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:38.021592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:38.022511 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:38.022892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:38.023171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] PATH_INFO: `/v3/projects/a3359b64312a4f06a3f2ac503b2ee164` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:38.024280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3359b64312a4f06a3f2ac503b2ee164)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:38.052736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:38.223508 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3359b64312a4f06a3f2ac503b2ee164', 'request_id': 'req-f703600d-7189-4dfa-b77b-7a07d2396892'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.292838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3359b64312a4f06a3f2ac503b2ee164', 'request_id': 'req-f703600d-7189-4dfa-b77b-7a07d2396892'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.305271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3359b64312a4f06a3f2ac503b2ee164', 'request_id': 'req-f703600d-7189-4dfa-b77b-7a07d2396892'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.315666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] The token cache is being invalidate because project a3359b64312a4f06a3f2ac503b2ee164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:38.315942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.316541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.317956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 954/1926] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:37 2022] DELETE /identity/v3/projects/a3359b64312a4f06a3f2ac503b2ee164 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:38.323595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207ecc-83d0-4ea8-a0c2-b97d7660377f None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:38.324086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207ecc-83d0-4ea8-a0c2-b97d7660377f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:38.324190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96207ecc-83d0-4ea8-a0c2-b97d7660377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:38.348012 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-96207ecc-83d0-4ea8-a0c2-b97d7660377f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:38.349274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-96207ecc-83d0-4ea8-a0c2-b97d7660377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:38.395234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:38.396785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:38.426839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 973/1927] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:38.436193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a217961-6760-44d3-b908-c5a5f818ecf5 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:38.436490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a217961-6760-44d3-b908-c5a5f818ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:38.437077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a217961-6760-44d3-b908-c5a5f818ecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:38.460509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-0a217961-6760-44d3-b908-c5a5f818ecf5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:38.461688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0a217961-6760-44d3-b908-c5a5f818ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:38.469444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703600d-7189-4dfa-b77b-7a07d2396892 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:38.469646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 974/1928] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:38.473652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a217961-6760-44d3-b908-c5a5f818ecf5 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:38.473811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:38.474626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:38.474918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:38.475203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] PATH_INFO: `/v3/users/7cd48a3ad0684fd2973c619f8d3bb967` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:38.476482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd48a3ad0684fd2973c619f8d3bb967)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:38.483990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a217961-6760-44d3-b908-c5a5f818ecf5 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:38.488953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbc436-b531-4f98-8eac-348c262b073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:38.489564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbc436-b531-4f98-8eac-348c262b073b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:38.489858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbc436-b531-4f98-8eac-348c262b073b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:38.490142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafbc436-b531-4f98-8eac-348c262b073b admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:38.490840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbc436-b531-4f98-8eac-348c262b073b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:11:38.491141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbc436-b531-4f98-8eac-348c262b073b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:38.503735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:38.518399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafbc436-b531-4f98-8eac-348c262b073b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:38.535349 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 975/1929] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:11:38.548283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbc436-b531-4f98-8eac-348c262b073b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:38.557471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafbc436-b531-4f98-8eac-348c262b073b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:38.563438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b4db6-2d1e-42d4-b756-a1f555db5b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:38.564046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b4db6-2d1e-42d4-b756-a1f555db5b9a admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:38.564341 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b4db6-2d1e-42d4-b756-a1f555db5b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:38.564630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b4db6-2d1e-42d4-b756-a1f555db5b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:38.569538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b4db6-2d1e-42d4-b756-a1f555db5b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:38.591478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b4db6-2d1e-42d4-b756-a1f555db5b9a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:38.745014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 976/1930] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:38 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:38.746045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b4db6-2d1e-42d4-b756-a1f555db5b9a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:38.790846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd48a3ad0684fd2973c619f8d3bb967'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.803763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd48a3ad0684fd2973c619f8d3bb967'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.804607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd48a3ad0684fd2973c619f8d3bb967'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.813570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd48a3ad0684fd2973c619f8d3bb967'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.826707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b4db6-2d1e-42d4-b756-a1f555db5b9a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:38.831504 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee76c03-3585-4aca-a882-ae5066bc6f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:38.832123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76c03-3585-4aca-a882-ae5066bc6f67 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:38.832408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76c03-3585-4aca-a882-ae5066bc6f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:38.832683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76c03-3585-4aca-a882-ae5066bc6f67 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:38.833326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee76c03-3585-4aca-a882-ae5066bc6f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:38.860723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee76c03-3585-4aca-a882-ae5066bc6f67 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:38.912014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85fc6378-c374-4ddf-b7e4-7fbb012e6398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd48a3ad0684fd2973c619f8d3bb967'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:38.918593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 955/1931] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:38 2022] DELETE /identity/v3/users/7cd48a3ad0684fd2973c619f8d3bb967 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:38.924926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be32d-c5d7-4e16-a560-a57ff44e9b79 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:38.925218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be32d-c5d7-4e16-a560-a57ff44e9b79 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:38.925500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be32d-c5d7-4e16-a560-a57ff44e9b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:38.948889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f51be32d-c5d7-4e16-a560-a57ff44e9b79 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:38.950054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f51be32d-c5d7-4e16-a560-a57ff44e9b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:39.015070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 956/1932] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:39.022897 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 977/1933] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:38 2022] POST /identity/v3/users => generated 284 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:39.024069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51be32d-c5d7-4e16-a560-a57ff44e9b79 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:39.025349 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f51be32d-c5d7-4e16-a560-a57ff44e9b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:39.025700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee76c03-3585-4aca-a882-ae5066bc6f67 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:39.027260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-eee76c03-3585-4aca-a882-ae5066bc6f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:39.037188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51be32d-c5d7-4e16-a560-a57ff44e9b79 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:39.041472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e74375-7ec7-4b4a-bb86-2727acd223e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:39.042066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e74375-7ec7-4b4a-bb86-2727acd223e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:39.042352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e74375-7ec7-4b4a-bb86-2727acd223e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:39.042634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e74375-7ec7-4b4a-bb86-2727acd223e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:39.043354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e74375-7ec7-4b4a-bb86-2727acd223e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:39.069734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e74375-7ec7-4b4a-bb86-2727acd223e7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:39.080823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 957/1934] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:39.084991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e74375-7ec7-4b4a-bb86-2727acd223e7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:39.095771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e74375-7ec7-4b4a-bb86-2727acd223e7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:39.100397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709e40-c4db-4efb-aa1a-f63cd81bc129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:39.101224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709e40-c4db-4efb-aa1a-f63cd81bc129 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:39.101509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709e40-c4db-4efb-aa1a-f63cd81bc129 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:39.101967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40709e40-c4db-4efb-aa1a-f63cd81bc129 admin admin] PATH_INFO: `/v3/projects/d98c518b0b7043e284e92608affcde46/users/a65b320f962142d6a7eaf6636b2c489e/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:39.116387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee76c03-3585-4aca-a882-ae5066bc6f67 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:39.129018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40709e40-c4db-4efb-aa1a-f63cd81bc129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98c518b0b7043e284e92608affcde46, user_id=a65b320f962142d6a7eaf6636b2c489e, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:39.158791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40709e40-c4db-4efb-aa1a-f63cd81bc129 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:39.178345 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4240b-16b4-4845-9dc4-edbecda3f29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:39.179020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4240b-16b4-4845-9dc4-edbecda3f29d service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:39.179415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4240b-16b4-4845-9dc4-edbecda3f29d service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:39.179748 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4240b-16b4-4845-9dc4-edbecda3f29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:39.189989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4240b-16b4-4845-9dc4-edbecda3f29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:39.220557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab4240b-16b4-4845-9dc4-edbecda3f29d service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:39.236961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 978/1935] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:39 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:11:39.254401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 958/1936] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:39 2022] PUT /identity/v3/projects/d98c518b0b7043e284e92608affcde46/users/a65b320f962142d6a7eaf6636b2c489e/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:39.265956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060c9f-4341-4090-babd-d7707a1c12f0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:39.266376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060c9f-4341-4090-babd-d7707a1c12f0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:39.266744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6060c9f-4341-4090-babd-d7707a1c12f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:39.313292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e6060c9f-4341-4090-babd-d7707a1c12f0 None None] MFA Rules not processed for user `a65b320f962142d6a7eaf6636b2c489e`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:39.314614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e6060c9f-4341-4090-babd-d7707a1c12f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:39.416560 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 979/1937] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:39 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:39.418831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709e40-c4db-4efb-aa1a-f63cd81bc129 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:39.497050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40709e40-c4db-4efb-aa1a-f63cd81bc129 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:39.501389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db51e7-dec5-4a3a-a0f9-c528a2d3c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:39.501974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db51e7-dec5-4a3a-a0f9-c528a2d3c8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:39.502257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db51e7-dec5-4a3a-a0f9-c528a2d3c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:39.502591 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db51e7-dec5-4a3a-a0f9-c528a2d3c8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:39.503177 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db51e7-dec5-4a3a-a0f9-c528a2d3c8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:39.532270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db51e7-dec5-4a3a-a0f9-c528a2d3c8c8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:39.652149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 959/1938] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:39 2022] POST /identity/v3/projects => generated 369 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:39.656449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6060c9f-4341-4090-babd-d7707a1c12f0 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:39.668044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6060c9f-4341-4090-babd-d7707a1c12f0 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:39.743014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb9d17-e96a-47c1-8911-d59bca109722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:39.743668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb9d17-e96a-47c1-8911-d59bca109722 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:39.743958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb9d17-e96a-47c1-8911-d59bca109722 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:39.744243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb9d17-e96a-47c1-8911-d59bca109722 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:39.744995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb9d17-e96a-47c1-8911-d59bca109722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:39.780018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb9d17-e96a-47c1-8911-d59bca109722 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:39.926695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 980/1939] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:39 2022] POST /identity/v3/users => generated 291 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:39.929712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db51e7-dec5-4a3a-a0f9-c528a2d3c8c8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:39.939889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db51e7-dec5-4a3a-a0f9-c528a2d3c8c8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:39.944057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3ebcf-8850-4a32-b831-a881c9c7f86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:39.944664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3ebcf-8850-4a32-b831-a881c9c7f86c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:39.944955 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3ebcf-8850-4a32-b831-a881c9c7f86c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:39.945242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3ebcf-8850-4a32-b831-a881c9c7f86c admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:39.945947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3ebcf-8850-4a32-b831-a881c9c7f86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:39.972656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3ebcf-8850-4a32-b831-a881c9c7f86c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:39.986295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 960/1940] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:39.988796 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3ebcf-8850-4a32-b831-a881c9c7f86c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:39.989406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb9d17-e96a-47c1-8911-d59bca109722 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:39.991210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-27cb9d17-e96a-47c1-8911-d59bca109722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:39.999233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3ebcf-8850-4a32-b831-a881c9c7f86c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:40.003726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdf30e-ec7f-4248-af53-dfe60ace4ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:40.004550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb9d17-e96a-47c1-8911-d59bca109722 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:40.004654 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdf30e-ec7f-4248-af53-dfe60ace4ef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:40.004995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdf30e-ec7f-4248-af53-dfe60ace4ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:40.005104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdf30e-ec7f-4248-af53-dfe60ace4ef4 admin admin] PATH_INFO: `/v3/projects/487d991a93194957939275d2995709cd/users/2bc697f890ca45cbb35f7b5d00d1530b/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:40.009145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:40.010023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:40.010376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:40.010840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] PATH_INFO: `/v3/projects/e990b2d1eaf944659c3c24249653b91e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:40.011998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e990b2d1eaf944659c3c24249653b91e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:40.026787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdf30e-ec7f-4248-af53-dfe60ace4ef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487d991a93194957939275d2995709cd, user_id=2bc697f890ca45cbb35f7b5d00d1530b, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:40.039884 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:40.054010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdf30e-ec7f-4248-af53-dfe60ace4ef4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:40.145333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 961/1941] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:39 2022] PUT /identity/v3/projects/487d991a93194957939275d2995709cd/users/2bc697f890ca45cbb35f7b5d00d1530b/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:40.149218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdf30e-ec7f-4248-af53-dfe60ace4ef4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:40.187682 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e990b2d1eaf944659c3c24249653b91e', 'request_id': 'req-35a10903-f31b-4094-a103-fc9e45036ed5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.217703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdf30e-ec7f-4248-af53-dfe60ace4ef4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:40.280545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c495be4-7e37-4ee5-9fdd-0009a082f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:40.281141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c495be4-7e37-4ee5-9fdd-0009a082f98e admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:40.281434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c495be4-7e37-4ee5-9fdd-0009a082f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:40.281718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c495be4-7e37-4ee5-9fdd-0009a082f98e admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:40.282410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c495be4-7e37-4ee5-9fdd-0009a082f98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:40.287209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e990b2d1eaf944659c3c24249653b91e', 'request_id': 'req-35a10903-f31b-4094-a103-fc9e45036ed5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.299775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e990b2d1eaf944659c3c24249653b91e', 'request_id': 'req-35a10903-f31b-4094-a103-fc9e45036ed5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.308257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c495be4-7e37-4ee5-9fdd-0009a082f98e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:40.310720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] The token cache is being invalidate because project e990b2d1eaf944659c3c24249653b91e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:40.311005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.311637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.313064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 981/1942] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:39 2022] DELETE /identity/v3/projects/e990b2d1eaf944659c3c24249653b91e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:40.317047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:40.318343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:40.322633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 962/1943] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:11:40.323610 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c495be4-7e37-4ee5-9fdd-0009a082f98e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:40.325912 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8c495be4-7e37-4ee5-9fdd-0009a082f98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:40.331255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a10903-f31b-4094-a103-fc9e45036ed5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:40.335856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:40.336680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:40.336964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:40.337192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c495be4-7e37-4ee5-9fdd-0009a082f98e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:40.337290 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] PATH_INFO: `/v3/users/5e018ba69aa44ce39b09cd4ff32982db` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:40.338325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e018ba69aa44ce39b09cd4ff32982db)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:40.341661 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde33b-4067-4577-9535-5b5c1ba284c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:40.342472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde33b-4067-4577-9535-5b5c1ba284c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:40.342757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde33b-4067-4577-9535-5b5c1ba284c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:40.343041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebde33b-4067-4577-9535-5b5c1ba284c4 admin admin] PATH_INFO: `/v3/projects/487d991a93194957939275d2995709cd/users/2bc697f890ca45cbb35f7b5d00d1530b/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:40.344976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde33b-4067-4577-9535-5b5c1ba284c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487d991a93194957939275d2995709cd, user_id=2bc697f890ca45cbb35f7b5d00d1530b, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:40.364021 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:40.371371 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebde33b-4067-4577-9535-5b5c1ba284c4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:40.382689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 963/1944] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:40 2022] PUT /identity/v3/projects/487d991a93194957939275d2995709cd/users/2bc697f890ca45cbb35f7b5d00d1530b/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:40.387362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde33b-4067-4577-9535-5b5c1ba284c4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:40.464625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebde33b-4067-4577-9535-5b5c1ba284c4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:40.469612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e8018-2072-4842-ad92-753d4fe1447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:40.470220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e8018-2072-4842-ad92-753d4fe1447d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:40.470513 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e8018-2072-4842-ad92-753d4fe1447d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:40.470988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e8018-2072-4842-ad92-753d4fe1447d admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:40.472237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e8018-2072-4842-ad92-753d4fe1447d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:40.500797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099e8018-2072-4842-ad92-753d4fe1447d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:40.511422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 964/1945] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:11:40.515550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e8018-2072-4842-ad92-753d4fe1447d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:40.524772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e8018-2072-4842-ad92-753d4fe1447d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:40.529890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9693075f-f598-4716-8498-481a9e6f15a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:40.530691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693075f-f598-4716-8498-481a9e6f15a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:40.532581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693075f-f598-4716-8498-481a9e6f15a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:40.532581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9693075f-f598-4716-8498-481a9e6f15a1 admin admin] PATH_INFO: `/v3/projects/487d991a93194957939275d2995709cd/users/2bc697f890ca45cbb35f7b5d00d1530b/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:40.533082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693075f-f598-4716-8498-481a9e6f15a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487d991a93194957939275d2995709cd, user_id=2bc697f890ca45cbb35f7b5d00d1530b, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:40.560558 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9693075f-f598-4716-8498-481a9e6f15a1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:40.568313 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e018ba69aa44ce39b09cd4ff32982db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.568937 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e018ba69aa44ce39b09cd4ff32982db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.577131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e018ba69aa44ce39b09cd4ff32982db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.594138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e018ba69aa44ce39b09cd4ff32982db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.643745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 965/1946] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:40 2022] PUT /identity/v3/projects/487d991a93194957939275d2995709cd/users/2bc697f890ca45cbb35f7b5d00d1530b/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:40.655437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f93c5-dff9-4c48-b221-895bb6e9cb2a None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:40.655737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f93c5-dff9-4c48-b221-895bb6e9cb2a None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:40.656035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f93c5-dff9-4c48-b221-895bb6e9cb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:40.666109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e018ba69aa44ce39b09cd4ff32982db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:40.673867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 982/1947] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:40 2022] DELETE /identity/v3/users/5e018ba69aa44ce39b09cd4ff32982db => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:40.697514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d26f93c5-dff9-4c48-b221-895bb6e9cb2a None None] MFA Rules not processed for user `2bc697f890ca45cbb35f7b5d00d1530b`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:40.698763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d26f93c5-dff9-4c48-b221-895bb6e9cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:40.780915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 966/1948] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:40 2022] POST /identity/v3/auth/tokens => generated 3743 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:40.791057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:40.792474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:40.870491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececf5b1-0971-4610-a925-b1f15ff0011a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:40.874155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fe873-5a8b-45eb-971d-058cb8cb6cbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:40.874736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fe873-5a8b-45eb-971d-058cb8cb6cbd service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:40.881272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fe873-5a8b-45eb-971d-058cb8cb6cbd service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:40.881272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fe873-5a8b-45eb-971d-058cb8cb6cbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:40.884429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fe873-5a8b-45eb-971d-058cb8cb6cbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:40.911436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159fe873-5a8b-45eb-971d-058cb8cb6cbd service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:40.921580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 983/1949] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:40 2022] GET /identity/v3/auth/tokens => generated 3743 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:41.086157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f93c5-dff9-4c48-b221-895bb6e9cb2a None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:41.088095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d26f93c5-dff9-4c48-b221-895bb6e9cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:41.105756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f93c5-dff9-4c48-b221-895bb6e9cb2a None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:41.110011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97531fe-2d9a-475b-9aaf-7833bdfc2bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:41.110609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97531fe-2d9a-475b-9aaf-7833bdfc2bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:41.110890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97531fe-2d9a-475b-9aaf-7833bdfc2bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:41.111166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97531fe-2d9a-475b-9aaf-7833bdfc2bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:41.112903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c97531fe-2d9a-475b-9aaf-7833bdfc2bf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:41.185923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97531fe-2d9a-475b-9aaf-7833bdfc2bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:41.211636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97531fe-2d9a-475b-9aaf-7833bdfc2bf0 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:41.222157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 967/1950] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:41 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:41.288647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fe873-5a8b-45eb-971d-058cb8cb6cbd service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:41.294720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-159fe873-5a8b-45eb-971d-058cb8cb6cbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:41.381148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fe873-5a8b-45eb-971d-058cb8cb6cbd service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:41.385442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:41.388210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:41.388210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:41.388210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] PATH_INFO: `/v3/projects/21d88300d6784e98ab760c524d3d31b1` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:41.388794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d88300d6784e98ab760c524d3d31b1)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:41.432985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:41.594791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d88300d6784e98ab760c524d3d31b1', 'request_id': 'req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:41.677452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d88300d6784e98ab760c524d3d31b1', 'request_id': 'req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:41.689591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d88300d6784e98ab760c524d3d31b1', 'request_id': 'req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:41.701012 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] The token cache is being invalidate because project 21d88300d6784e98ab760c524d3d31b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:41.701435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:41.702270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:41.703961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 984/1951] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:41 2022] DELETE /identity/v3/projects/21d88300d6784e98ab760c524d3d31b1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:41.707842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97531fe-2d9a-475b-9aaf-7833bdfc2bf0 service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:41.719034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97531fe-2d9a-475b-9aaf-7833bdfc2bf0 service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:41.788758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:41.789572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:41.789866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:41.790147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] PATH_INFO: `/v3/users/5173950662cf45b5be7bad37ff033c8c` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:41.791244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5173950662cf45b5be7bad37ff033c8c)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:41.817648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:42.154984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5173950662cf45b5be7bad37ff033c8c'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:42.166858 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5173950662cf45b5be7bad37ff033c8c'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:42.167547 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5173950662cf45b5be7bad37ff033c8c'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:42.176619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5173950662cf45b5be7bad37ff033c8c'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:42.249325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-732c73bb-107a-44c1-a078-47c6cd8c785b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5173950662cf45b5be7bad37ff033c8c'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:42.255704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 968/1952] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:41 2022] DELETE /identity/v3/users/5173950662cf45b5be7bad37ff033c8c => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:42.824403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:42.825914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:42.839482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e3f62-6ee8-44b5-bdc3-82c24bd9fdad admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:42.905889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:42.906683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:42.906971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:42.907252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] PATH_INFO: `/v3/projects/04c80cf7d8844e74aaa468ce1690616d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:42.908383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c80cf7d8844e74aaa468ce1690616d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:42.935002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:43.057289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c80cf7d8844e74aaa468ce1690616d', 'request_id': 'req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:43.135172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c80cf7d8844e74aaa468ce1690616d', 'request_id': 'req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:43.147971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c80cf7d8844e74aaa468ce1690616d', 'request_id': 'req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:43.159859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] The token cache is being invalidate because project 04c80cf7d8844e74aaa468ce1690616d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:43.160211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:43.160902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-84c9c730-2acb-4c9e-9dec-1fc1f1b16483 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:43.162627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 985/1953] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:42 2022] DELETE /identity/v3/projects/04c80cf7d8844e74aaa468ce1690616d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:43.169809 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890cbfe-5a56-4391-bc1f-11ea02b8efcf None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:43.170308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890cbfe-5a56-4391-bc1f-11ea02b8efcf None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:43.170409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890cbfe-5a56-4391-bc1f-11ea02b8efcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:43.197239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1890cbfe-5a56-4391-bc1f-11ea02b8efcf None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:43.199273 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1890cbfe-5a56-4391-bc1f-11ea02b8efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:43.271896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 969/1954] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:43.274578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356966c-ac81-4a54-8aab-9c0b35175126 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:43.274880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356966c-ac81-4a54-8aab-9c0b35175126 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:43.275166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356966c-ac81-4a54-8aab-9c0b35175126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:43.301928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f356966c-ac81-4a54-8aab-9c0b35175126 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:43.303183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f356966c-ac81-4a54-8aab-9c0b35175126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:43.310957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 986/1955] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:43 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:43.315365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890cbfe-5a56-4391-bc1f-11ea02b8efcf None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:43.324664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890cbfe-5a56-4391-bc1f-11ea02b8efcf None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:43.329699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fe975-3e79-4e58-9404-0c57f6329db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:43.330295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fe975-3e79-4e58-9404-0c57f6329db7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:43.330582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fe975-3e79-4e58-9404-0c57f6329db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:43.330863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fe975-3e79-4e58-9404-0c57f6329db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:43.331586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fe975-3e79-4e58-9404-0c57f6329db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:11:43.331888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fe975-3e79-4e58-9404-0c57f6329db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:43.357624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fe975-3e79-4e58-9404-0c57f6329db7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:43.373930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 970/1956] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:11:43.382922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356966c-ac81-4a54-8aab-9c0b35175126 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:43.393923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356966c-ac81-4a54-8aab-9c0b35175126 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:43.398644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8ad8-fc8e-4391-9c02-0c27bba7d9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:43.399271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8ad8-fc8e-4391-9c02-0c27bba7d9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:43.405214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8ad8-fc8e-4391-9c02-0c27bba7d9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:43.405214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f8ad8-fc8e-4391-9c02-0c27bba7d9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:43.405960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f8ad8-fc8e-4391-9c02-0c27bba7d9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:43.436099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f8ad8-fc8e-4391-9c02-0c27bba7d9b6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:43.555769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 987/1957] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:43 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:43.556944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fe975-3e79-4e58-9404-0c57f6329db7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:43.567352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fe975-3e79-4e58-9404-0c57f6329db7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:43.718692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742967-0622-4406-bc3b-15ca24627643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:43.719363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742967-0622-4406-bc3b-15ca24627643 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:43.719635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742967-0622-4406-bc3b-15ca24627643 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:43.719922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6742967-0622-4406-bc3b-15ca24627643 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:43.720567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6742967-0622-4406-bc3b-15ca24627643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:43.746377 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6742967-0622-4406-bc3b-15ca24627643 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:44.008972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 971/1958] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:43 2022] POST /identity/v3/users => generated 283 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:44.018830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8ad8-fc8e-4391-9c02-0c27bba7d9b6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:44.029922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f8ad8-fc8e-4391-9c02-0c27bba7d9b6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:44.034179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda3d43-26dc-4247-8d15-0d26a371f736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:44.034800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda3d43-26dc-4247-8d15-0d26a371f736 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:44.035088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda3d43-26dc-4247-8d15-0d26a371f736 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:44.035401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda3d43-26dc-4247-8d15-0d26a371f736 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:44.036089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda3d43-26dc-4247-8d15-0d26a371f736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:44.062510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda3d43-26dc-4247-8d15-0d26a371f736 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:44.074672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 988/1959] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:44.082057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742967-0622-4406-bc3b-15ca24627643 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:44.092993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6742967-0622-4406-bc3b-15ca24627643 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:44.097274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d78ce-4b56-4911-88a6-3e0f5fc6130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:44.098088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d78ce-4b56-4911-88a6-3e0f5fc6130c admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:44.098375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d78ce-4b56-4911-88a6-3e0f5fc6130c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:44.098652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d78ce-4b56-4911-88a6-3e0f5fc6130c admin admin] PATH_INFO: `/v3/projects/a6f7a829335e4ff19bd9c8d5457ff6bf/users/4673c951ea5a4884a41f29ddf10ae2e0/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:44.126840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d78ce-4b56-4911-88a6-3e0f5fc6130c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f7a829335e4ff19bd9c8d5457ff6bf, user_id=4673c951ea5a4884a41f29ddf10ae2e0, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:44.156111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d78ce-4b56-4911-88a6-3e0f5fc6130c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:44.233132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 972/1960] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:44 2022] PUT /identity/v3/projects/a6f7a829335e4ff19bd9c8d5457ff6bf/users/4673c951ea5a4884a41f29ddf10ae2e0/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:44.246820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41ced-24d3-43eb-ac3f-5cd69bc3d569 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:44.247318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41ced-24d3-43eb-ac3f-5cd69bc3d569 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:44.247498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41ced-24d3-43eb-ac3f-5cd69bc3d569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:44.284846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-60e41ced-24d3-43eb-ac3f-5cd69bc3d569 None None] MFA Rules not processed for user `4673c951ea5a4884a41f29ddf10ae2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:44.285992 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-60e41ced-24d3-43eb-ac3f-5cd69bc3d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:44.363351 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 989/1961] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:44 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:44.367811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d78ce-4b56-4911-88a6-3e0f5fc6130c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:44.480084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d78ce-4b56-4911-88a6-3e0f5fc6130c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:44.480084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e85b-318e-418f-a26b-170c42cc1e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:44.480084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e85b-318e-418f-a26b-170c42cc1e1c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:44.480084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e85b-318e-418f-a26b-170c42cc1e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:44.480462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268e85b-318e-418f-a26b-170c42cc1e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:44.480462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268e85b-318e-418f-a26b-170c42cc1e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:44.502396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268e85b-318e-418f-a26b-170c42cc1e1c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:44.706350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 973/1962] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:44 2022] POST /identity/v3/projects => generated 367 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:44.710618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41ced-24d3-43eb-ac3f-5cd69bc3d569 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:44.722384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41ced-24d3-43eb-ac3f-5cd69bc3d569 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:44.788935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dde20-f90e-486d-a3e5-4205d9f02057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:44.789555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dde20-f90e-486d-a3e5-4205d9f02057 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:44.789845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dde20-f90e-486d-a3e5-4205d9f02057 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:44.790133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3dde20-f90e-486d-a3e5-4205d9f02057 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:44.790780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dde20-f90e-486d-a3e5-4205d9f02057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:44.818090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3dde20-f90e-486d-a3e5-4205d9f02057 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:44.953625 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 990/1963] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:44 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:44.957641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e85b-318e-418f-a26b-170c42cc1e1c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:44.968042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268e85b-318e-418f-a26b-170c42cc1e1c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:44.972327 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8fc8-0a2a-4bcc-adc4-09a79b6a1978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:44.972927 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8fc8-0a2a-4bcc-adc4-09a79b6a1978 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:44.973222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8fc8-0a2a-4bcc-adc4-09a79b6a1978 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:44.973544 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8fc8-0a2a-4bcc-adc4-09a79b6a1978 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:44.974244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8fc8-0a2a-4bcc-adc4-09a79b6a1978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:45.000695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8fc8-0a2a-4bcc-adc4-09a79b6a1978 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:45.012155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 974/1964] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:45.017770 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dde20-f90e-486d-a3e5-4205d9f02057 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:45.027252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3dde20-f90e-486d-a3e5-4205d9f02057 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:45.032453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff7b9-6850-4784-bc3d-1453a04e8c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:45.033265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff7b9-6850-4784-bc3d-1453a04e8c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:45.033616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff7b9-6850-4784-bc3d-1453a04e8c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:45.033850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fff7b9-6850-4784-bc3d-1453a04e8c19 admin admin] PATH_INFO: `/v3/projects/9e26ba5fa42a44a795578c11a65a0c25/users/87a93edc7b5e4618a9c287913859fcd1/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:45.054724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff7b9-6850-4784-bc3d-1453a04e8c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e26ba5fa42a44a795578c11a65a0c25, user_id=87a93edc7b5e4618a9c287913859fcd1, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:45.082415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fff7b9-6850-4784-bc3d-1453a04e8c19 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:45.163885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 991/1965] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:45 2022] PUT /identity/v3/projects/9e26ba5fa42a44a795578c11a65a0c25/users/87a93edc7b5e4618a9c287913859fcd1/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:45.168812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8fc8-0a2a-4bcc-adc4-09a79b6a1978 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:45.179634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8fc8-0a2a-4bcc-adc4-09a79b6a1978 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:45.245129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bdb02-1588-4b6e-9789-2c26347088d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:45.245749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bdb02-1588-4b6e-9789-2c26347088d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:45.246035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bdb02-1588-4b6e-9789-2c26347088d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:45.246314 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672bdb02-1588-4b6e-9789-2c26347088d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:45.247090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bdb02-1588-4b6e-9789-2c26347088d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:45.274538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672bdb02-1588-4b6e-9789-2c26347088d3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:45.287777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 975/1966] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:45.292053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff7b9-6850-4784-bc3d-1453a04e8c19 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:45.302135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fff7b9-6850-4784-bc3d-1453a04e8c19 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:45.306570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed45a67-f226-41a0-9224-078a231e9a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:45.307486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed45a67-f226-41a0-9224-078a231e9a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:45.307839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed45a67-f226-41a0-9224-078a231e9a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:45.308120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed45a67-f226-41a0-9224-078a231e9a1d admin admin] PATH_INFO: `/v3/projects/9e26ba5fa42a44a795578c11a65a0c25/users/87a93edc7b5e4618a9c287913859fcd1/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:45.309884 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed45a67-f226-41a0-9224-078a231e9a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e26ba5fa42a44a795578c11a65a0c25, user_id=87a93edc7b5e4618a9c287913859fcd1, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:45.337038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed45a67-f226-41a0-9224-078a231e9a1d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:45.348177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 992/1967] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:45 2022] PUT /identity/v3/projects/9e26ba5fa42a44a795578c11a65a0c25/users/87a93edc7b5e4618a9c287913859fcd1/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:45.352372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bdb02-1588-4b6e-9789-2c26347088d3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:45.364057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672bdb02-1588-4b6e-9789-2c26347088d3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:45.434539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6497c-89cb-4fcd-b991-2afb22b2adec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:45.435590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6497c-89cb-4fcd-b991-2afb22b2adec admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:45.436214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6497c-89cb-4fcd-b991-2afb22b2adec admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:45.436682 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6497c-89cb-4fcd-b991-2afb22b2adec admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:45.437576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6497c-89cb-4fcd-b991-2afb22b2adec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:45.466597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6497c-89cb-4fcd-b991-2afb22b2adec admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:45.477965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 976/1968] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:11:45.483322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed45a67-f226-41a0-9224-078a231e9a1d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:45.493225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed45a67-f226-41a0-9224-078a231e9a1d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:45.498095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c5157-2a1a-4d49-91d1-18e2e1383297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:45.498880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c5157-2a1a-4d49-91d1-18e2e1383297 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:45.499169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c5157-2a1a-4d49-91d1-18e2e1383297 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:45.499487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c5157-2a1a-4d49-91d1-18e2e1383297 admin admin] PATH_INFO: `/v3/projects/9e26ba5fa42a44a795578c11a65a0c25/users/87a93edc7b5e4618a9c287913859fcd1/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:45.501264 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c5157-2a1a-4d49-91d1-18e2e1383297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e26ba5fa42a44a795578c11a65a0c25, user_id=87a93edc7b5e4618a9c287913859fcd1, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:45.527642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c5157-2a1a-4d49-91d1-18e2e1383297 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:45.631948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 993/1969] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:45 2022] PUT /identity/v3/projects/9e26ba5fa42a44a795578c11a65a0c25/users/87a93edc7b5e4618a9c287913859fcd1/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:45.644787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731d54-c39c-4b0b-bbd7-3240c5745a8e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:45.645478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731d54-c39c-4b0b-bbd7-3240c5745a8e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:45.645709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22731d54-c39c-4b0b-bbd7-3240c5745a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:45.686038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-22731d54-c39c-4b0b-bbd7-3240c5745a8e None None] MFA Rules not processed for user `87a93edc7b5e4618a9c287913859fcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:45.687395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-22731d54-c39c-4b0b-bbd7-3240c5745a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:45.788148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 977/1970] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:45 2022] POST /identity/v3/auth/tokens => generated 3741 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:45.800494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c5157-2a1a-4d49-91d1-18e2e1383297 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:45.802346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ad9c5157-2a1a-4d49-91d1-18e2e1383297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:45.873608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c5157-2a1a-4d49-91d1-18e2e1383297 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:45.877432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61eaa-5b37-4e8d-90d6-98f013c2a980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:45.878027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61eaa-5b37-4e8d-90d6-98f013c2a980 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:45.878317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61eaa-5b37-4e8d-90d6-98f013c2a980 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:45.878599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc61eaa-5b37-4e8d-90d6-98f013c2a980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:45.888286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc61eaa-5b37-4e8d-90d6-98f013c2a980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:45.924083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc61eaa-5b37-4e8d-90d6-98f013c2a980 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:45.933803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 994/1971] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:45 2022] GET /identity/v3/auth/tokens => generated 3741 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:46.337989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22731d54-c39c-4b0b-bbd7-3240c5745a8e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:46.339333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-22731d54-c39c-4b0b-bbd7-3240c5745a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:46.423904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22731d54-c39c-4b0b-bbd7-3240c5745a8e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:46.427708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:46.429207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:46.429651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:46.430005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] PATH_INFO: `/v3/users/e1b04ad91baa4396893714752968ddb4` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:46.431495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b04ad91baa4396893714752968ddb4)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:46.468076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:46.505723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61eaa-5b37-4e8d-90d6-98f013c2a980 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:46.514263 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc61eaa-5b37-4e8d-90d6-98f013c2a980 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:46.519416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1b752-4f3a-41cb-9ac3-38de93d87096 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:46.519416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1b752-4f3a-41cb-9ac3-38de93d87096 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:46.519416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1b752-4f3a-41cb-9ac3-38de93d87096 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:46.519416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1b752-4f3a-41cb-9ac3-38de93d87096 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:46.589953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1b752-4f3a-41cb-9ac3-38de93d87096 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:46.617651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1b752-4f3a-41cb-9ac3-38de93d87096 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:46.630954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 995/1972] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:46 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:11:46.756514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b04ad91baa4396893714752968ddb4'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:46.769872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b04ad91baa4396893714752968ddb4'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:46.770668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b04ad91baa4396893714752968ddb4'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:46.780204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b04ad91baa4396893714752968ddb4'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:47.158110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b04ad91baa4396893714752968ddb4'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:47.171301 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfacac2-bdef-46f8-8411-c70e7c1b17e9 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:47.171632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfacac2-bdef-46f8-8411-c70e7c1b17e9 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:47.175414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfacac2-bdef-46f8-8411-c70e7c1b17e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:47.175530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 978/1973] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:46 2022] DELETE /identity/v3/users/e1b04ad91baa4396893714752968ddb4 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:47.196309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-dcfacac2-bdef-46f8-8411-c70e7c1b17e9 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:47.197512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-dcfacac2-bdef-46f8-8411-c70e7c1b17e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:47.271206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 996/1974] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:47.282173 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:47.283562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:47.350751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309313d-5029-4f26-972d-804d4a3bf6ef admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:47.354960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576889c-f5d4-426c-b8f5-0ef7dd2f9355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:47.355680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576889c-f5d4-426c-b8f5-0ef7dd2f9355 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:47.356060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576889c-f5d4-426c-b8f5-0ef7dd2f9355 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:47.357080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576889c-f5d4-426c-b8f5-0ef7dd2f9355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:47.367977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576889c-f5d4-426c-b8f5-0ef7dd2f9355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:47.394249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576889c-f5d4-426c-b8f5-0ef7dd2f9355 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:47.405018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 979/1975] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:47 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:47.900808 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfacac2-bdef-46f8-8411-c70e7c1b17e9 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:47.903696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-dcfacac2-bdef-46f8-8411-c70e7c1b17e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:47.923968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfacac2-bdef-46f8-8411-c70e7c1b17e9 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:47.930628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:47.931974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:47.932432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:47.932910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] PATH_INFO: `/v3/users/a65b320f962142d6a7eaf6636b2c489e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:47.934655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65b320f962142d6a7eaf6636b2c489e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:47.985121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:48.027731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576889c-f5d4-426c-b8f5-0ef7dd2f9355 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:48.031606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-2576889c-f5d4-426c-b8f5-0ef7dd2f9355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:48.047425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576889c-f5d4-426c-b8f5-0ef7dd2f9355 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:48.054515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:48.055968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:48.056476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:48.056988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] PATH_INFO: `/v3/projects/8ea1e91bd9e945aa84db3aaddc86540f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:48.059024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea1e91bd9e945aa84db3aaddc86540f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:48.118014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:48.226306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65b320f962142d6a7eaf6636b2c489e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.226916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65b320f962142d6a7eaf6636b2c489e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.235206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65b320f962142d6a7eaf6636b2c489e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.248304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65b320f962142d6a7eaf6636b2c489e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.270560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea1e91bd9e945aa84db3aaddc86540f', 'request_id': 'req-9e7a7213-d7c6-41e5-96fc-e5400309ec13'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.384090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7acada5d-506b-431d-bd9e-546f5780c1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65b320f962142d6a7eaf6636b2c489e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.393947 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 997/1976] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:47 2022] DELETE /identity/v3/users/a65b320f962142d6a7eaf6636b2c489e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:48.403519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21205e-2fd8-4fd1-840f-4184ee8f7b2b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:48.404319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21205e-2fd8-4fd1-840f-4184ee8f7b2b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:48.405131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21205e-2fd8-4fd1-840f-4184ee8f7b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:48.442181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-cd21205e-2fd8-4fd1-840f-4184ee8f7b2b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:48.443918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cd21205e-2fd8-4fd1-840f-4184ee8f7b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:48.465766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea1e91bd9e945aa84db3aaddc86540f', 'request_id': 'req-9e7a7213-d7c6-41e5-96fc-e5400309ec13'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.487017 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea1e91bd9e945aa84db3aaddc86540f', 'request_id': 'req-9e7a7213-d7c6-41e5-96fc-e5400309ec13'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.501896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] The token cache is being invalidate because project 8ea1e91bd9e945aa84db3aaddc86540f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:48.502177 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.502801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.504283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 980/1977] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:48 2022] DELETE /identity/v3/projects/8ea1e91bd9e945aa84db3aaddc86540f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:48.508032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:48.509341 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:48.513379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 998/1978] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:48 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:48.523688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21205e-2fd8-4fd1-840f-4184ee8f7b2b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:48.525285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cd21205e-2fd8-4fd1-840f-4184ee8f7b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:48.594529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a7213-d7c6-41e5-96fc-e5400309ec13 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:48.598859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:48.599713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:48.600003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:48.600289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] PATH_INFO: `/v3/users/39d531a5895547f4bd093d84e7aa069d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:48.601395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d531a5895547f4bd093d84e7aa069d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:48.601532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21205e-2fd8-4fd1-840f-4184ee8f7b2b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:48.604866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fecbf-6f53-448e-88a5-15c45034c8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:48.605442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fecbf-6f53-448e-88a5-15c45034c8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:48.605726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fecbf-6f53-448e-88a5-15c45034c8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:48.606008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645fecbf-6f53-448e-88a5-15c45034c8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:48.617705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fecbf-6f53-448e-88a5-15c45034c8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:48.629093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:48.643513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645fecbf-6f53-448e-88a5-15c45034c8b1 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:48.661855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 999/1979] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:11:48.961311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d531a5895547f4bd093d84e7aa069d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.977435 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d531a5895547f4bd093d84e7aa069d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.978299 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d531a5895547f4bd093d84e7aa069d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:48.988294 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d531a5895547f4bd093d84e7aa069d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:49.071883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d531a5895547f4bd093d84e7aa069d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:49.079129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 981/1980] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:48 2022] DELETE /identity/v3/users/39d531a5895547f4bd093d84e7aa069d => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:49.348964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fecbf-6f53-448e-88a5-15c45034c8b1 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:49.350945 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-645fecbf-6f53-448e-88a5-15c45034c8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:49.382280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645fecbf-6f53-448e-88a5-15c45034c8b1 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:49.478108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:49.479821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:49.480157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:49.480553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] PATH_INFO: `/v3/projects/d98c518b0b7043e284e92608affcde46` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:49.483433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98c518b0b7043e284e92608affcde46)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:49.517530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:49.702380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98c518b0b7043e284e92608affcde46', 'request_id': 'req-b6ab9c84-cf69-4ee6-9040-56182ec8202c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:49.932429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:49.934337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:49.955051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ce1468-afd7-4295-8878-a3d89555b28a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:50.026103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:50.026900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:50.027185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:50.027493 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] PATH_INFO: `/v3/projects/9e4dff800c264fce8892758d8df6ba06` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:50.028850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e4dff800c264fce8892758d8df6ba06)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:50.054568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:50.060292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98c518b0b7043e284e92608affcde46', 'request_id': 'req-b6ab9c84-cf69-4ee6-9040-56182ec8202c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.087302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98c518b0b7043e284e92608affcde46', 'request_id': 'req-b6ab9c84-cf69-4ee6-9040-56182ec8202c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.099280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] The token cache is being invalidate because project d98c518b0b7043e284e92608affcde46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:50.099593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.100222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.101657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1000/1981] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:49 2022] DELETE /identity/v3/projects/d98c518b0b7043e284e92608affcde46 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:50.105706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:50.107039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:50.119953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab9c84-cf69-4ee6-9040-56182ec8202c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:50.126803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:50.126803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:50.126803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:50.127172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] PATH_INFO: `/v3/users/2bc697f890ca45cbb35f7b5d00d1530b` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:50.128240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc697f890ca45cbb35f7b5d00d1530b)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:50.156476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:50.284702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e4dff800c264fce8892758d8df6ba06', 'request_id': 'req-c45bffa2-432d-4b2f-8309-df85d68d255a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.429735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e4dff800c264fce8892758d8df6ba06', 'request_id': 'req-c45bffa2-432d-4b2f-8309-df85d68d255a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.441787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e4dff800c264fce8892758d8df6ba06', 'request_id': 'req-c45bffa2-432d-4b2f-8309-df85d68d255a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.452239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] The token cache is being invalidate because project 9e4dff800c264fce8892758d8df6ba06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:50.452555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.453132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-c45bffa2-432d-4b2f-8309-df85d68d255a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.454550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 982/1982] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:49 2022] DELETE /identity/v3/projects/9e4dff800c264fce8892758d8df6ba06 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:50.460624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e52e4f-7f1a-419f-8aab-ef83fcca0b65 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:50.460914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e52e4f-7f1a-419f-8aab-ef83fcca0b65 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:50.461192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e52e4f-7f1a-419f-8aab-ef83fcca0b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:50.487039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc697f890ca45cbb35f7b5d00d1530b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.488173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc697f890ca45cbb35f7b5d00d1530b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.496999 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc697f890ca45cbb35f7b5d00d1530b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.504687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-81e52e4f-7f1a-419f-8aab-ef83fcca0b65 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:50.506840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-81e52e4f-7f1a-419f-8aab-ef83fcca0b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:50.531615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc697f890ca45cbb35f7b5d00d1530b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.602330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 983/1983] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:50.611031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0bade-cd4b-453f-adf9-266d0dd33717 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:50.611551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0bade-cd4b-453f-adf9-266d0dd33717 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:50.612011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0bade-cd4b-453f-adf9-266d0dd33717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:50.637640 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-53e0bade-cd4b-453f-adf9-266d0dd33717 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:50.638372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc697f890ca45cbb35f7b5d00d1530b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:50.638801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-53e0bade-cd4b-453f-adf9-266d0dd33717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:50.651083 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 984/1984] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:50.654007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1001/1985] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:50 2022] DELETE /identity/v3/users/2bc697f890ca45cbb35f7b5d00d1530b => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:50.662551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0bade-cd4b-453f-adf9-266d0dd33717 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:50.682057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0bade-cd4b-453f-adf9-266d0dd33717 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:50.767047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb236ed7-aa09-414d-9935-943c79c8c688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:50.768069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb236ed7-aa09-414d-9935-943c79c8c688 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:50.768324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb236ed7-aa09-414d-9935-943c79c8c688 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:50.772619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb236ed7-aa09-414d-9935-943c79c8c688 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:50.772619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb236ed7-aa09-414d-9935-943c79c8c688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:11:50.772619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb236ed7-aa09-414d-9935-943c79c8c688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:50.797964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb236ed7-aa09-414d-9935-943c79c8c688 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:50.812093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 985/1986] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:11:50.816973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:50.840878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5997c44-b1aa-4a04-a24b-e021de9c60c7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:50.850207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef560f-ca2d-4410-9a69-07cf93f5b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:50.850814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef560f-ca2d-4410-9a69-07cf93f5b67a admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:50.851108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef560f-ca2d-4410-9a69-07cf93f5b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:50.851425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef560f-ca2d-4410-9a69-07cf93f5b67a admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:50.852079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef560f-ca2d-4410-9a69-07cf93f5b67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:50.878906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef560f-ca2d-4410-9a69-07cf93f5b67a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:51.037154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1002/1987] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:50 2022] POST /identity/v3/projects => generated 409 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:51.040548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb236ed7-aa09-414d-9935-943c79c8c688 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:51.055660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb236ed7-aa09-414d-9935-943c79c8c688 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:51.166512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc9336-e341-47ba-aa52-b7ab151dc98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:51.167134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc9336-e341-47ba-aa52-b7ab151dc98b admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.167462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc9336-e341-47ba-aa52-b7ab151dc98b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.167743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc9336-e341-47ba-aa52-b7ab151dc98b admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.168397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc9336-e341-47ba-aa52-b7ab151dc98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:51.198054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cc9336-e341-47ba-aa52-b7ab151dc98b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:51.311723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 986/1988] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:51 2022] POST /identity/v3/users => generated 305 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:51.316111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef560f-ca2d-4410-9a69-07cf93f5b67a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:51.327269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef560f-ca2d-4410-9a69-07cf93f5b67a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:51.331741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b083b90-d764-4629-b78c-87bd7761e457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:51.332521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083b90-d764-4629-b78c-87bd7761e457 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.332941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083b90-d764-4629-b78c-87bd7761e457 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.333279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b083b90-d764-4629-b78c-87bd7761e457 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.334141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b083b90-d764-4629-b78c-87bd7761e457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:51.361543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b083b90-d764-4629-b78c-87bd7761e457 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:51.374864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1003/1989] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:51.375941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc9336-e341-47ba-aa52-b7ab151dc98b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:51.377242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b083b90-d764-4629-b78c-87bd7761e457 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:51.378022 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b4cc9336-e341-47ba-aa52-b7ab151dc98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:51.392376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b083b90-d764-4629-b78c-87bd7761e457 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:51.392480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc9336-e341-47ba-aa52-b7ab151dc98b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:51.393154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77d646-a0d5-48bf-a12d-961adba6a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:51.393974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77d646-a0d5-48bf-a12d-961adba6a8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.394262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77d646-a0d5-48bf-a12d-961adba6a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.394542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77d646-a0d5-48bf-a12d-961adba6a8aa admin admin] PATH_INFO: `/v3/projects/9a28518dc0894d7bab06418ca3b1124f/users/849bb42032844d6e9df9847c3a80385c/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.395217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:51.396126 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.396412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.396685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] PATH_INFO: `/v3/projects/487d991a93194957939275d2995709cd` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.397762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] RBAC: Authorizing `identity:delete_project(project_id=487d991a93194957939275d2995709cd)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:51.416976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77d646-a0d5-48bf-a12d-961adba6a8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a28518dc0894d7bab06418ca3b1124f, user_id=849bb42032844d6e9df9847c3a80385c, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:51.425795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:51.443603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77d646-a0d5-48bf-a12d-961adba6a8aa admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:51.528195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1004/1990] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:51 2022] PUT /identity/v3/projects/9a28518dc0894d7bab06418ca3b1124f/users/849bb42032844d6e9df9847c3a80385c/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:51.538849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc6f4-2aa1-403f-91ca-484c6b78c128 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.539146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc6f4-2aa1-403f-91ca-484c6b78c128 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.539469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc6f4-2aa1-403f-91ca-484c6b78c128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.576484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487d991a93194957939275d2995709cd', 'request_id': 'req-12878d5b-2288-4a75-b105-1ae3eae0219e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:51.578440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-affcc6f4-2aa1-403f-91ca-484c6b78c128 None None] MFA Rules not processed for user `849bb42032844d6e9df9847c3a80385c`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:51.579674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-affcc6f4-2aa1-403f-91ca-484c6b78c128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:51.657497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1005/1991] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3716 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:51.661816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcc6f4-2aa1-403f-91ca-484c6b78c128 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:51.723226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487d991a93194957939275d2995709cd', 'request_id': 'req-12878d5b-2288-4a75-b105-1ae3eae0219e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:51.735859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcc6f4-2aa1-403f-91ca-484c6b78c128 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:51.736762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487d991a93194957939275d2995709cd', 'request_id': 'req-12878d5b-2288-4a75-b105-1ae3eae0219e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:51.740631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d4608-9ade-4a4a-b179-8728cdc0300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:51.743215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d4608-9ade-4a4a-b179-8728cdc0300e admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.743215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d4608-9ade-4a4a-b179-8728cdc0300e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.743215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d4608-9ade-4a4a-b179-8728cdc0300e admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.743215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d4608-9ade-4a4a-b179-8728cdc0300e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:51.747935 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] The token cache is being invalidate because project 487d991a93194957939275d2995709cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:51.752998 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:51.753916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-12878d5b-2288-4a75-b105-1ae3eae0219e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:51.755789 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 987/1992] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:51 2022] DELETE /identity/v3/projects/487d991a93194957939275d2995709cd => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:51.761233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1789408-e3c3-4193-8e40-b967c3d93a61 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.761591 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1789408-e3c3-4193-8e40-b967c3d93a61 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.761985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1789408-e3c3-4193-8e40-b967c3d93a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.771856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d4608-9ade-4a4a-b179-8728cdc0300e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:51.792861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f1789408-e3c3-4193-8e40-b967c3d93a61 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:51.794080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f1789408-e3c3-4193-8e40-b967c3d93a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:51.802840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 988/1993] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:51.811787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab34ee-89fc-476a-bb60-696b3b95cb27 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.811931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab34ee-89fc-476a-bb60-696b3b95cb27 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.812286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab34ee-89fc-476a-bb60-696b3b95cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.837781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b9ab34ee-89fc-476a-bb60-696b3b95cb27 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:51.838933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b9ab34ee-89fc-476a-bb60-696b3b95cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:51.846605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 989/1994] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:51.850974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab34ee-89fc-476a-bb60-696b3b95cb27 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:51.860339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab34ee-89fc-476a-bb60-696b3b95cb27 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:51.864743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c5b70-0a46-4995-8be3-2eb5f2c42272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:51.865339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c5b70-0a46-4995-8be3-2eb5f2c42272 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.865629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c5b70-0a46-4995-8be3-2eb5f2c42272 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.865909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c5b70-0a46-4995-8be3-2eb5f2c42272 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.866602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c5b70-0a46-4995-8be3-2eb5f2c42272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:11:51.866898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c5b70-0a46-4995-8be3-2eb5f2c42272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:51.893596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863c5b70-0a46-4995-8be3-2eb5f2c42272 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:51.908720 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 990/1995] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:11:51.913150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c5b70-0a46-4995-8be3-2eb5f2c42272 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:51.922781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c5b70-0a46-4995-8be3-2eb5f2c42272 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:51.927289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97196fd-40db-4744-9596-10cd439d5f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:51.927906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97196fd-40db-4744-9596-10cd439d5f0c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:51.928195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97196fd-40db-4744-9596-10cd439d5f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:51.928478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97196fd-40db-4744-9596-10cd439d5f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:51.929147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97196fd-40db-4744-9596-10cd439d5f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:51.938349 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1006/1996] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:51 2022] POST /identity/v3/projects => generated 405 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:51.947886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d4608-9ade-4a4a-b179-8728cdc0300e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:51.949664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ea7d4608-9ade-4a4a-b179-8728cdc0300e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:51.959209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97196fd-40db-4744-9596-10cd439d5f0c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:52.037331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d4608-9ade-4a4a-b179-8728cdc0300e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:52.043240 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f21f2-9901-4ef4-93f5-50f201b78e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:52.044116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f21f2-9901-4ef4-93f5-50f201b78e13 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.044442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f21f2-9901-4ef4-93f5-50f201b78e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.044975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f21f2-9901-4ef4-93f5-50f201b78e13 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.046155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f21f2-9901-4ef4-93f5-50f201b78e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:52.075553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f21f2-9901-4ef4-93f5-50f201b78e13 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:52.095110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 991/1997] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:51 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:52.099767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97196fd-40db-4744-9596-10cd439d5f0c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:52.202622 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1007/1998] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:51 2022] POST /identity/v3/users => generated 309 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:52.208009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97196fd-40db-4744-9596-10cd439d5f0c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:52.208362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f21f2-9901-4ef4-93f5-50f201b78e13 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:52.213487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a5a2c-8733-4f4e-9408-236bfe657ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:52.214263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a5a2c-8733-4f4e-9408-236bfe657ffa admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.214610 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a5a2c-8733-4f4e-9408-236bfe657ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.214900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a5a2c-8733-4f4e-9408-236bfe657ffa admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.218877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f21f2-9901-4ef4-93f5-50f201b78e13 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:52.219878 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a5a2c-8733-4f4e-9408-236bfe657ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:52.223729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301f375-a12e-4dc0-b91c-23e5548a6da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:52.224338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301f375-a12e-4dc0-b91c-23e5548a6da0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.224676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301f375-a12e-4dc0-b91c-23e5548a6da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.224960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301f375-a12e-4dc0-b91c-23e5548a6da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.225650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301f375-a12e-4dc0-b91c-23e5548a6da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:52.247874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a5a2c-8733-4f4e-9408-236bfe657ffa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:52.252650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301f375-a12e-4dc0-b91c-23e5548a6da0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:52.269469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1008/1999] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:52.269469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301f375-a12e-4dc0-b91c-23e5548a6da0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:52.272539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5301f375-a12e-4dc0-b91c-23e5548a6da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:52.284189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301f375-a12e-4dc0-b91c-23e5548a6da0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:52.288627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:52.289426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.289715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.290000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] PATH_INFO: `/v3/users/5025d62943284c309a389c2c5b8ea4db` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.291289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5025d62943284c309a389c2c5b8ea4db)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:52.320143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:52.416671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 992/2000] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:52 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:52.416671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a5a2c-8733-4f4e-9408-236bfe657ffa admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:52.425405 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a5a2c-8733-4f4e-9408-236bfe657ffa admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:52.429945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2541f-49a8-4179-9b0c-bb091c4dff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:52.430780 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2541f-49a8-4179-9b0c-bb091c4dff3b admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.431069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2541f-49a8-4179-9b0c-bb091c4dff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.431411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2541f-49a8-4179-9b0c-bb091c4dff3b admin admin] PATH_INFO: `/v3/projects/eeb2698f3d6b46a99ed1532252bacb13/users/a99654d240924319b7564e1a4b74c8e1/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.451827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2541f-49a8-4179-9b0c-bb091c4dff3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb2698f3d6b46a99ed1532252bacb13, user_id=a99654d240924319b7564e1a4b74c8e1, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:52.479132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2541f-49a8-4179-9b0c-bb091c4dff3b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:52.584770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 993/2001] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:52 2022] PUT /identity/v3/projects/eeb2698f3d6b46a99ed1532252bacb13/users/a99654d240924319b7564e1a4b74c8e1/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:52.585961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2541f-49a8-4179-9b0c-bb091c4dff3b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:52.624810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5025d62943284c309a389c2c5b8ea4db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:52.625589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5025d62943284c309a389c2c5b8ea4db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:52.643074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5025d62943284c309a389c2c5b8ea4db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:52.662666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5025d62943284c309a389c2c5b8ea4db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:52.692910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2541f-49a8-4179-9b0c-bb091c4dff3b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:52.703820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d0e7-78cb-4ef3-bc6c-cd2adc327e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:52.703820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d0e7-78cb-4ef3-bc6c-cd2adc327e89 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.703820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d0e7-78cb-4ef3-bc6c-cd2adc327e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.703820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035d0e7-78cb-4ef3-bc6c-cd2adc327e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.704324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035d0e7-78cb-4ef3-bc6c-cd2adc327e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:52.731336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035d0e7-78cb-4ef3-bc6c-cd2adc327e89 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:52.747287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 994/2002] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:52.747287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d0e7-78cb-4ef3-bc6c-cd2adc327e89 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:52.755087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035d0e7-78cb-4ef3-bc6c-cd2adc327e89 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:52.756921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5025d62943284c309a389c2c5b8ea4db'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:52.759956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180a726-5225-47d1-8821-c0d2e06e123c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:52.760554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180a726-5225-47d1-8821-c0d2e06e123c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.760839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180a726-5225-47d1-8821-c0d2e06e123c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.761257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180a726-5225-47d1-8821-c0d2e06e123c admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.761956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180a726-5225-47d1-8821-c0d2e06e123c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:52.763367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1009/2003] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:52 2022] DELETE /identity/v3/users/5025d62943284c309a389c2c5b8ea4db => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:52.764258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:52.767760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:52.787577 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180a726-5225-47d1-8821-c0d2e06e123c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:52.802303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 995/2004] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:52.802303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaad72-8895-461f-9580-e32a63a2e208 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.802303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaad72-8895-461f-9580-e32a63a2e208 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.802303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaad72-8895-461f-9580-e32a63a2e208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.829986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-fccaad72-8895-461f-9580-e32a63a2e208 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:52.832429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-fccaad72-8895-461f-9580-e32a63a2e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:52.844466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fe3d2-896d-487f-b52b-16a4c4c263ad admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:52.846441 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 996/2005] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:52.847898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaad72-8895-461f-9580-e32a63a2e208 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:52.849475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-fccaad72-8895-461f-9580-e32a63a2e208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:52.850136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2f2b-3030-41d8-a4b4-8a768afa8b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:52.859139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2f2b-3030-41d8-a4b4-8a768afa8b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.859700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2f2b-3030-41d8-a4b4-8a768afa8b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.860091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ac2f2b-3030-41d8-a4b4-8a768afa8b3f admin admin] PATH_INFO: `/v3/projects/e7095f983c5045239ef0e03031ae3d99/users/b7747d57c0434ce8a084d42c9aaef960/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.870385 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaad72-8895-461f-9580-e32a63a2e208 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:52.879185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de927a50-8da9-44d3-aee5-783c038e9555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:52.880086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de927a50-8da9-44d3-aee5-783c038e9555 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:52.881332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de927a50-8da9-44d3-aee5-783c038e9555 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:52.881671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de927a50-8da9-44d3-aee5-783c038e9555 admin admin] PATH_INFO: `/v3/projects/eeb2698f3d6b46a99ed1532252bacb13/users/a99654d240924319b7564e1a4b74c8e1/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:52.883896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de927a50-8da9-44d3-aee5-783c038e9555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb2698f3d6b46a99ed1532252bacb13, user_id=a99654d240924319b7564e1a4b74c8e1, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:52.892589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac2f2b-3030-41d8-a4b4-8a768afa8b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7095f983c5045239ef0e03031ae3d99, user_id=b7747d57c0434ce8a084d42c9aaef960, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:52.912012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de927a50-8da9-44d3-aee5-783c038e9555 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:52.923997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 997/2006] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:52 2022] PUT /identity/v3/projects/eeb2698f3d6b46a99ed1532252bacb13/users/a99654d240924319b7564e1a4b74c8e1/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:52.927537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de927a50-8da9-44d3-aee5-783c038e9555 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:52.929164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-de927a50-8da9-44d3-aee5-783c038e9555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:52.950244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ac2f2b-3030-41d8-a4b4-8a768afa8b3f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:53.053173 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de927a50-8da9-44d3-aee5-783c038e9555 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:53.060099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1010/2007] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:52 2022] PUT /identity/v3/projects/e7095f983c5045239ef0e03031ae3d99/users/b7747d57c0434ce8a084d42c9aaef960/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:53.069242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2f2b-3030-41d8-a4b4-8a768afa8b3f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:53.174657 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a636d6c-001f-468a-95c4-72e4a440d705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:53.175851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636d6c-001f-468a-95c4-72e4a440d705 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:53.176519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636d6c-001f-468a-95c4-72e4a440d705 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:53.177336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a636d6c-001f-468a-95c4-72e4a440d705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:53.254061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ac2f2b-3030-41d8-a4b4-8a768afa8b3f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:53.262692 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21bb6c9-fa94-48e8-b510-9b053bea9216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:53.263776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bb6c9-fa94-48e8-b510-9b053bea9216 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:53.265237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bb6c9-fa94-48e8-b510-9b053bea9216 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:53.265626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21bb6c9-fa94-48e8-b510-9b053bea9216 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:53.267218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21bb6c9-fa94-48e8-b510-9b053bea9216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:53.276924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a636d6c-001f-468a-95c4-72e4a440d705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:53.298331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21bb6c9-fa94-48e8-b510-9b053bea9216 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:53.307952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a636d6c-001f-468a-95c4-72e4a440d705 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:53.309500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1011/2008] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:53.311427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f6422-7fa6-48c3-ac68-15ff13d37533 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:53.311721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f6422-7fa6-48c3-ac68-15ff13d37533 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:53.311996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f6422-7fa6-48c3-ac68-15ff13d37533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:53.319213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 998/2009] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:52 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:53.320008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a636d6c-001f-468a-95c4-72e4a440d705 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:53.332210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a636d6c-001f-468a-95c4-72e4a440d705 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:53.336688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b56ff9-7dee-44da-bfd0-00045717044b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:53.337522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b56ff9-7dee-44da-bfd0-00045717044b admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:53.337813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b56ff9-7dee-44da-bfd0-00045717044b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:53.338103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b56ff9-7dee-44da-bfd0-00045717044b admin admin] PATH_INFO: `/v3/projects/eeb2698f3d6b46a99ed1532252bacb13/users/a99654d240924319b7564e1a4b74c8e1/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:53.340103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b56ff9-7dee-44da-bfd0-00045717044b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb2698f3d6b46a99ed1532252bacb13, user_id=a99654d240924319b7564e1a4b74c8e1, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:53.352231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c63f6422-7fa6-48c3-ac68-15ff13d37533 None None] MFA Rules not processed for user `b7747d57c0434ce8a084d42c9aaef960`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:53.353384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c63f6422-7fa6-48c3-ac68-15ff13d37533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:53.368387 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b56ff9-7dee-44da-bfd0-00045717044b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:53.462843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1012/2010] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:53 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:53.468474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f6422-7fa6-48c3-ac68-15ff13d37533 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:53.478941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f6422-7fa6-48c3-ac68-15ff13d37533 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:53.483972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcf347-f2b5-4031-94ca-69552fc71993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:53.484722 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf347-f2b5-4031-94ca-69552fc71993 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:53.485011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf347-f2b5-4031-94ca-69552fc71993 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:53.485336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcf347-f2b5-4031-94ca-69552fc71993 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:53.486007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf347-f2b5-4031-94ca-69552fc71993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:53.505584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 999/2011] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:53 2022] PUT /identity/v3/projects/eeb2698f3d6b46a99ed1532252bacb13/users/a99654d240924319b7564e1a4b74c8e1/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:53.512994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcf347-f2b5-4031-94ca-69552fc71993 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:53.516254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329498dc-3034-4181-a5df-8840c19e53a7 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:53.516552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329498dc-3034-4181-a5df-8840c19e53a7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:53.516867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329498dc-3034-4181-a5df-8840c19e53a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:53.555725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-329498dc-3034-4181-a5df-8840c19e53a7 None None] MFA Rules not processed for user `a99654d240924319b7564e1a4b74c8e1`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:53.558488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-329498dc-3034-4181-a5df-8840c19e53a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:53.634169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1013/2012] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:53 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:53.640577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcf347-f2b5-4031-94ca-69552fc71993 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:53.670209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1000/2013] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:53 2022] POST /identity/v3/auth/tokens => generated 3779 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:53.681656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329498dc-3034-4181-a5df-8840c19e53a7 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:53.682986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-329498dc-3034-4181-a5df-8840c19e53a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:53.769391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcf347-f2b5-4031-94ca-69552fc71993 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:53.774355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af3727-9ddb-4e87-917a-b7f44536498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:53.775012 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af3727-9ddb-4e87-917a-b7f44536498a admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:53.777458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329498dc-3034-4181-a5df-8840c19e53a7 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:53.779683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af3727-9ddb-4e87-917a-b7f44536498a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:53.781151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af3727-9ddb-4e87-917a-b7f44536498a admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:53.783367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af3727-9ddb-4e87-917a-b7f44536498a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:53.825300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af3727-9ddb-4e87-917a-b7f44536498a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:53.843298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926ab5c-b5e3-4ab9-b45d-740ec813be1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:53.844025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926ab5c-b5e3-4ab9-b45d-740ec813be1d service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:53.844416 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926ab5c-b5e3-4ab9-b45d-740ec813be1d service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:53.844797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926ab5c-b5e3-4ab9-b45d-740ec813be1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:53.914759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926ab5c-b5e3-4ab9-b45d-740ec813be1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:53.942141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1926ab5c-b5e3-4ab9-b45d-740ec813be1d service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:53.955877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1001/2014] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:53 2022] GET /identity/v3/auth/tokens => generated 3779 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:53.957308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926ab5c-b5e3-4ab9-b45d-740ec813be1d service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:53.958741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1926ab5c-b5e3-4ab9-b45d-740ec813be1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:53.973814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1014/2015] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:53 2022] POST /identity/v3/users => generated 294 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:53.974917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af3727-9ddb-4e87-917a-b7f44536498a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:53.978107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926ab5c-b5e3-4ab9-b45d-740ec813be1d service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:53.985170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:53.985979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:53.986269 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:53.986548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] PATH_INFO: `/v3/projects/9471741b26204c92b55d9ebed1020e0d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:53.988129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9471741b26204c92b55d9ebed1020e0d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:53.993203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af3727-9ddb-4e87-917a-b7f44536498a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:54.005188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1865e-b0ac-4b89-b928-17bc6d504015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:54.005794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1865e-b0ac-4b89-b928-17bc6d504015 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:54.006080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1865e-b0ac-4b89-b928-17bc6d504015 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:54.006362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1865e-b0ac-4b89-b928-17bc6d504015 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:54.007057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1865e-b0ac-4b89-b928-17bc6d504015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:54.033803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1865e-b0ac-4b89-b928-17bc6d504015 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:54.037523 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:54.044706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1015/2016] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:11:54.048936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1865e-b0ac-4b89-b928-17bc6d504015 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:54.060431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1865e-b0ac-4b89-b928-17bc6d504015 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:54.074377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c037e-4c54-4b96-96ad-eba16fb7770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:54.075332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c037e-4c54-4b96-96ad-eba16fb7770b admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:54.075681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c037e-4c54-4b96-96ad-eba16fb7770b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:54.076031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c037e-4c54-4b96-96ad-eba16fb7770b admin admin] PATH_INFO: `/v3/projects/364cfd5b57584c6a8d466398c4a7927f/users/b30fbc0706f642928a22a452864659f6/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:54.101985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c037e-4c54-4b96-96ad-eba16fb7770b admin admin] RBAC: Authorizing `identity:create_grant(project_id=364cfd5b57584c6a8d466398c4a7927f, user_id=b30fbc0706f642928a22a452864659f6, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:54.130967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c037e-4c54-4b96-96ad-eba16fb7770b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:54.283349 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1016/2017] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:54 2022] PUT /identity/v3/projects/364cfd5b57584c6a8d466398c4a7927f/users/b30fbc0706f642928a22a452864659f6/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:54.285387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c87bd-a16b-46fc-be9b-a3aa41e6b6ee None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:54.285685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c87bd-a16b-46fc-be9b-a3aa41e6b6ee None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:54.285974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c87bd-a16b-46fc-be9b-a3aa41e6b6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:54.288024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9471741b26204c92b55d9ebed1020e0d', 'request_id': 'req-0a858906-cc72-4755-9a1f-7e107ba001a4'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.324202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-db9c87bd-a16b-46fc-be9b-a3aa41e6b6ee None None] MFA Rules not processed for user `b30fbc0706f642928a22a452864659f6`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:54.325334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-db9c87bd-a16b-46fc-be9b-a3aa41e6b6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:54.375816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9471741b26204c92b55d9ebed1020e0d', 'request_id': 'req-0a858906-cc72-4755-9a1f-7e107ba001a4'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.390473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9471741b26204c92b55d9ebed1020e0d', 'request_id': 'req-0a858906-cc72-4755-9a1f-7e107ba001a4'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.403766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] The token cache is being invalidate because project 9471741b26204c92b55d9ebed1020e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:54.404257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.406503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.409948 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1002/2018] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:53 2022] DELETE /identity/v3/projects/9471741b26204c92b55d9ebed1020e0d => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:54.413885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:54.415420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:54.450737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1017/2019] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:54 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:54.456280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c87bd-a16b-46fc-be9b-a3aa41e6b6ee None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:54.512745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a858906-cc72-4755-9a1f-7e107ba001a4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:54.518117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:54.519078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:54.519656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:54.519943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] PATH_INFO: `/v3/users/0506f4653ab641a69a409f3ffe5c34e9` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:54.521058 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0506f4653ab641a69a409f3ffe5c34e9)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:54.564748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:54.568114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c87bd-a16b-46fc-be9b-a3aa41e6b6ee None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:54.575510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3a426-7690-4464-b1be-feeacf323ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:54.577072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3a426-7690-4464-b1be-feeacf323ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:54.577520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3a426-7690-4464-b1be-feeacf323ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:54.578342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3a426-7690-4464-b1be-feeacf323ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:54.580853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3a426-7690-4464-b1be-feeacf323ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:54.608454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3a426-7690-4464-b1be-feeacf323ef6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:54.732061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1018/2020] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:54 2022] POST /identity/v3/projects => generated 387 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:54.732061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3a426-7690-4464-b1be-feeacf323ef6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:54.740031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-56a3a426-7690-4464-b1be-feeacf323ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:54.784814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0506f4653ab641a69a409f3ffe5c34e9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.801313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0506f4653ab641a69a409f3ffe5c34e9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.802660 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0506f4653ab641a69a409f3ffe5c34e9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.812827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0506f4653ab641a69a409f3ffe5c34e9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.813869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3a426-7690-4464-b1be-feeacf323ef6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:54.817543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:54.818179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:54.818473 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:54.818753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:54.820535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:54.907595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:54.909736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0506f4653ab641a69a409f3ffe5c34e9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:54.921762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1003/2021] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:54 2022] DELETE /identity/v3/users/0506f4653ab641a69a409f3ffe5c34e9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:54.921762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:54.921762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:54.936123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:54.950768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1019/2022] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:54 2022] GET /identity/v3/auth/tokens => generated 3716 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:55.077351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512c421-f7a4-45fa-a4d8-fd051c8c7650 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:55.083367 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f30a-d4ab-4996-beba-a907d03387d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:55.084188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f30a-d4ab-4996-beba-a907d03387d1 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:55.087961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f30a-d4ab-4996-beba-a907d03387d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:55.087961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673f30a-d4ab-4996-beba-a907d03387d1 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:55.087961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f30a-d4ab-4996-beba-a907d03387d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:55.117546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673f30a-d4ab-4996-beba-a907d03387d1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:55.192786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1004/2023] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:54 2022] POST /identity/v3/users => generated 300 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:55.198193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:55.199606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:55.275909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d794bf-b25a-4016-a964-d9452683b6d1 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:55.281557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecea87-9775-4ac5-b0cb-38bec315a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:55.282167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecea87-9775-4ac5-b0cb-38bec315a34e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:55.282455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecea87-9775-4ac5-b0cb-38bec315a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:55.282737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecea87-9775-4ac5-b0cb-38bec315a34e admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:55.283578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecea87-9775-4ac5-b0cb-38bec315a34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:55.309219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecea87-9775-4ac5-b0cb-38bec315a34e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:55.320658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1020/2024] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:55.325163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f30a-d4ab-4996-beba-a907d03387d1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:55.336512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673f30a-d4ab-4996-beba-a907d03387d1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:55.340876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80f700-b510-444c-a969-f1c39cd0eadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:55.341698 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80f700-b510-444c-a969-f1c39cd0eadf admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:55.342021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80f700-b510-444c-a969-f1c39cd0eadf admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:55.342333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80f700-b510-444c-a969-f1c39cd0eadf admin admin] PATH_INFO: `/v3/projects/37c373c3a89e4425b2e8a2466dd65876/users/c9cccac9e22c4498a292ad7b84ffa663/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:55.364945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80f700-b510-444c-a969-f1c39cd0eadf admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c373c3a89e4425b2e8a2466dd65876, user_id=c9cccac9e22c4498a292ad7b84ffa663, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:55.393119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80f700-b510-444c-a969-f1c39cd0eadf admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:55.539225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecea87-9775-4ac5-b0cb-38bec315a34e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:55.541187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f7ecea87-9775-4ac5-b0cb-38bec315a34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:55.553455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1005/2025] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:55 2022] PUT /identity/v3/projects/37c373c3a89e4425b2e8a2466dd65876/users/c9cccac9e22c4498a292ad7b84ffa663/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:55.557217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecea87-9775-4ac5-b0cb-38bec315a34e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:55.557365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80f700-b510-444c-a969-f1c39cd0eadf admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:55.635932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:55.636624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:55.636906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:55.637188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] PATH_INFO: `/v3/projects/e828ca9bd173498f810912b1d39dbc53` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:55.638681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e828ca9bd173498f810912b1d39dbc53)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:55.659612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80f700-b510-444c-a969-f1c39cd0eadf admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:55.664168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e2195-702c-4eef-aaf0-8b4d81a82f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:55.664762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e2195-702c-4eef-aaf0-8b4d81a82f34 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:55.665048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e2195-702c-4eef-aaf0-8b4d81a82f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:55.665337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e2195-702c-4eef-aaf0-8b4d81a82f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:55.665442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:55.669646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e2195-702c-4eef-aaf0-8b4d81a82f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:55.693527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e2195-702c-4eef-aaf0-8b4d81a82f34 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:55.707145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1006/2026] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:55.708459 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e2195-702c-4eef-aaf0-8b4d81a82f34 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:55.719115 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e2195-702c-4eef-aaf0-8b4d81a82f34 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:55.735292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811a6fb-f6d6-47ed-9a52-5aa9bc963be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:55.736514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a6fb-f6d6-47ed-9a52-5aa9bc963be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:55.737081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a6fb-f6d6-47ed-9a52-5aa9bc963be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:55.737549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a6fb-f6d6-47ed-9a52-5aa9bc963be4 admin admin] PATH_INFO: `/v3/projects/37c373c3a89e4425b2e8a2466dd65876/users/c9cccac9e22c4498a292ad7b84ffa663/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:55.740718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811a6fb-f6d6-47ed-9a52-5aa9bc963be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c373c3a89e4425b2e8a2466dd65876, user_id=c9cccac9e22c4498a292ad7b84ffa663, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:55.780177 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811a6fb-f6d6-47ed-9a52-5aa9bc963be4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:55.798030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1007/2027] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:55 2022] PUT /identity/v3/projects/37c373c3a89e4425b2e8a2466dd65876/users/c9cccac9e22c4498a292ad7b84ffa663/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:55.802709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811a6fb-f6d6-47ed-9a52-5aa9bc963be4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:55.866313 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e828ca9bd173498f810912b1d39dbc53', 'request_id': 'req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:55.884228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811a6fb-f6d6-47ed-9a52-5aa9bc963be4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:55.958655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e09ea-884e-4297-82aa-ef6fa8b9bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:55.959263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e09ea-884e-4297-82aa-ef6fa8b9bee0 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:55.959585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e09ea-884e-4297-82aa-ef6fa8b9bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:55.959867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e09ea-884e-4297-82aa-ef6fa8b9bee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:55.960563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e09ea-884e-4297-82aa-ef6fa8b9bee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:55.968994 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e828ca9bd173498f810912b1d39dbc53', 'request_id': 'req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:55.981347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e828ca9bd173498f810912b1d39dbc53', 'request_id': 'req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:55.987031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e09ea-884e-4297-82aa-ef6fa8b9bee0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:55.992559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] The token cache is being invalidate because project e828ca9bd173498f810912b1d39dbc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:55.992969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:55.993647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9a9bb2a1-4b19-4b25-94d0-afd7f48fb35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:55.995161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1021/2028] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:55 2022] DELETE /identity/v3/projects/e828ca9bd173498f810912b1d39dbc53 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:56.001343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1008/2029] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:11:56.001611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8061ce-37bf-4cad-bf47-3927777fadfc None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.001957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8061ce-37bf-4cad-bf47-3927777fadfc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.002248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8061ce-37bf-4cad-bf47-3927777fadfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.005342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e09ea-884e-4297-82aa-ef6fa8b9bee0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:56.006916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d45e09ea-884e-4297-82aa-ef6fa8b9bee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:56.025497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e09ea-884e-4297-82aa-ef6fa8b9bee0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:56.025497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe46ae-7d38-4f3d-96e6-708a9c8443e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:56.025497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe46ae-7d38-4f3d-96e6-708a9c8443e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.025497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe46ae-7d38-4f3d-96e6-708a9c8443e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.026062 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe46ae-7d38-4f3d-96e6-708a9c8443e9 admin admin] PATH_INFO: `/v3/projects/37c373c3a89e4425b2e8a2466dd65876/users/c9cccac9e22c4498a292ad7b84ffa663/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.026144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-bd8061ce-37bf-4cad-bf47-3927777fadfc None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:56.026279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-bd8061ce-37bf-4cad-bf47-3927777fadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:56.028216 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe46ae-7d38-4f3d-96e6-708a9c8443e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c373c3a89e4425b2e8a2466dd65876, user_id=c9cccac9e22c4498a292ad7b84ffa663, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:56.035284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1022/2030] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:56.043583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2bc5d-2b64-45dd-a87a-1158f04a4e1d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.043969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2bc5d-2b64-45dd-a87a-1158f04a4e1d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.044439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2bc5d-2b64-45dd-a87a-1158f04a4e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.069658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5ed2bc5d-2b64-45dd-a87a-1158f04a4e1d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:56.070802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5ed2bc5d-2b64-45dd-a87a-1158f04a4e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:56.079498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1023/2031] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:56.083289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2bc5d-2b64-45dd-a87a-1158f04a4e1d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:56.090791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe46ae-7d38-4f3d-96e6-708a9c8443e9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:56.103973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2bc5d-2b64-45dd-a87a-1158f04a4e1d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:56.109477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32877c-8a2a-4f02-bd37-e502dc511d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:56.110205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32877c-8a2a-4f02-bd37-e502dc511d9d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.110632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32877c-8a2a-4f02-bd37-e502dc511d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.110989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32877c-8a2a-4f02-bd37-e502dc511d9d admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.111815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32877c-8a2a-4f02-bd37-e502dc511d9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:11:56.112219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32877c-8a2a-4f02-bd37-e502dc511d9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:56.139967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32877c-8a2a-4f02-bd37-e502dc511d9d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:56.163349 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1024/2032] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:11:56.167406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32877c-8a2a-4f02-bd37-e502dc511d9d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:56.178198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32877c-8a2a-4f02-bd37-e502dc511d9d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:56.184617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1009/2033] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:56 2022] PUT /identity/v3/projects/37c373c3a89e4425b2e8a2466dd65876/users/c9cccac9e22c4498a292ad7b84ffa663/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:11:56.194773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ba8a-895b-4977-bae9-724ec4186975 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.195483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ba8a-895b-4977-bae9-724ec4186975 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.195816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3ba8a-895b-4977-bae9-724ec4186975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.238107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-9ae3ba8a-895b-4977-bae9-724ec4186975 None None] MFA Rules not processed for user `c9cccac9e22c4498a292ad7b84ffa663`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:56.239249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9ae3ba8a-895b-4977-bae9-724ec4186975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:56.258375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92447788-fa38-40f0-abe5-37f6eb07e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:56.258970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92447788-fa38-40f0-abe5-37f6eb07e784 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.259258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92447788-fa38-40f0-abe5-37f6eb07e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.259573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92447788-fa38-40f0-abe5-37f6eb07e784 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.260260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92447788-fa38-40f0-abe5-37f6eb07e784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:56.289466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92447788-fa38-40f0-abe5-37f6eb07e784 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:56.327588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1010/2034] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:56.333902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ba8a-895b-4977-bae9-724ec4186975 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:56.335290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9ae3ba8a-895b-4977-bae9-724ec4186975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:56.387874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1025/2035] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:56 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:11:56.392939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92447788-fa38-40f0-abe5-37f6eb07e784 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:56.407872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3ba8a-895b-4977-bae9-724ec4186975 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:56.469480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92447788-fa38-40f0-abe5-37f6eb07e784 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:56.473283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1803e70-c2ff-4169-97a2-68f7cef5d93b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:56.474036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1803e70-c2ff-4169-97a2-68f7cef5d93b service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.474457 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1803e70-c2ff-4169-97a2-68f7cef5d93b service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.474989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f27596-8856-4aa8-8c8a-6339026447ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:56.475156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1803e70-c2ff-4169-97a2-68f7cef5d93b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.475758 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f27596-8856-4aa8-8c8a-6339026447ef admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.476051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f27596-8856-4aa8-8c8a-6339026447ef admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.476333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f27596-8856-4aa8-8c8a-6339026447ef admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.476981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f27596-8856-4aa8-8c8a-6339026447ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:56.504530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f27596-8856-4aa8-8c8a-6339026447ef admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:56.548250 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1803e70-c2ff-4169-97a2-68f7cef5d93b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:56.574840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1803e70-c2ff-4169-97a2-68f7cef5d93b service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:56.591015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1011/2036] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:56 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:11:56.623762 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1026/2037] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:11:56 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:11:56.624726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1803e70-c2ff-4169-97a2-68f7cef5d93b service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:56.635670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1803e70-c2ff-4169-97a2-68f7cef5d93b service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:56.649085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c96cc-14d0-4303-923b-6b4a7887119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:56.653465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c96cc-14d0-4303-923b-6b4a7887119c admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.653465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c96cc-14d0-4303-923b-6b4a7887119c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.653465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c96cc-14d0-4303-923b-6b4a7887119c admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.653465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c96cc-14d0-4303-923b-6b4a7887119c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:56.678887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c96cc-14d0-4303-923b-6b4a7887119c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:56.692415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1012/2038] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:11:56.696753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f27596-8856-4aa8-8c8a-6339026447ef admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:56.708194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f27596-8856-4aa8-8c8a-6339026447ef admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:56.713203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ca24a-781f-4dca-bd22-ec2ae4dbab81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:56.714036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ca24a-781f-4dca-bd22-ec2ae4dbab81 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.714333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ca24a-781f-4dca-bd22-ec2ae4dbab81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.714620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ca24a-781f-4dca-bd22-ec2ae4dbab81 admin admin] PATH_INFO: `/v3/projects/5075a85e517e428ab3a0fa357d9344cb/users/61be93d2eb7e4c5d9565d812bb738223/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.736530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ca24a-781f-4dca-bd22-ec2ae4dbab81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5075a85e517e428ab3a0fa357d9344cb, user_id=61be93d2eb7e4c5d9565d812bb738223, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:56.764510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ca24a-781f-4dca-bd22-ec2ae4dbab81 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:56.926507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1027/2039] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:11:56 2022] PUT /identity/v3/projects/5075a85e517e428ab3a0fa357d9344cb/users/61be93d2eb7e4c5d9565d812bb738223/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:56.932112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec28e8f-f137-48eb-80c7-49b6df051cfa None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:56.932415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec28e8f-f137-48eb-80c7-49b6df051cfa None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:56.932702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec28e8f-f137-48eb-80c7-49b6df051cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:56.993492 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-7ec28e8f-f137-48eb-80c7-49b6df051cfa None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:56.997815 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7ec28e8f-f137-48eb-80c7-49b6df051cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:57.146409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1013/2040] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:57.158354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ca24a-781f-4dca-bd22-ec2ae4dbab81 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:57.164968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-442ca24a-781f-4dca-bd22-ec2ae4dbab81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:57.240139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ca24a-781f-4dca-bd22-ec2ae4dbab81 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:57.243985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fccf07-3870-4782-8dbc-168fd7326f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:57.244631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fccf07-3870-4782-8dbc-168fd7326f59 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:57.244988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fccf07-3870-4782-8dbc-168fd7326f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:57.245327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fccf07-3870-4782-8dbc-168fd7326f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:57.255700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fccf07-3870-4782-8dbc-168fd7326f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:57.284095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fccf07-3870-4782-8dbc-168fd7326f59 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:57.299267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1028/2041] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:57 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:57.687766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec28e8f-f137-48eb-80c7-49b6df051cfa None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:57.689242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7ec28e8f-f137-48eb-80c7-49b6df051cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:57.707741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec28e8f-f137-48eb-80c7-49b6df051cfa None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:57.707741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:57.707741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:57.707741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:57.708131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] PATH_INFO: `/v3/users/4673c951ea5a4884a41f29ddf10ae2e0` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:57.708131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4673c951ea5a4884a41f29ddf10ae2e0)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:57.735213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:58.017565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4673c951ea5a4884a41f29ddf10ae2e0'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:58.030644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4673c951ea5a4884a41f29ddf10ae2e0'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:58.031424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4673c951ea5a4884a41f29ddf10ae2e0'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:58.047360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4673c951ea5a4884a41f29ddf10ae2e0'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:58.134790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4673c951ea5a4884a41f29ddf10ae2e0'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:58.147623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d02d7-c918-4f6e-8aba-0bd93edae538 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:58.148084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d02d7-c918-4f6e-8aba-0bd93edae538 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:58.148377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d02d7-c918-4f6e-8aba-0bd93edae538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:58.153699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1014/2042] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:57 2022] DELETE /identity/v3/users/4673c951ea5a4884a41f29ddf10ae2e0 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:58.200475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-866d02d7-c918-4f6e-8aba-0bd93edae538 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:58.205621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-866d02d7-c918-4f6e-8aba-0bd93edae538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:58.328582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1029/2043] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:11:58.339144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:58.340644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:58.349250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d02d7-c918-4f6e-8aba-0bd93edae538 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:58.350488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-866d02d7-c918-4f6e-8aba-0bd93edae538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:58.450331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d02d7-c918-4f6e-8aba-0bd93edae538 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:58.454475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9d5a0-1330-476e-9551-77bbf3b5672d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:58.455053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d5a0-1330-476e-9551-77bbf3b5672d service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:58.455359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d5a0-1330-476e-9551-77bbf3b5672d service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:58.455644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9d5a0-1330-476e-9551-77bbf3b5672d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:58.467664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9d5a0-1330-476e-9551-77bbf3b5672d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:58.492672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dae78c-1153-4cba-beeb-283500a9fa89 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:58.496322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e88a4-1bf1-40b2-973b-207808630a3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:58.497170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e88a4-1bf1-40b2-973b-207808630a3a service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:58.497170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e88a4-1bf1-40b2-973b-207808630a3a service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:58.497469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e88a4-1bf1-40b2-973b-207808630a3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:58.503522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9d5a0-1330-476e-9551-77bbf3b5672d service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:58.515710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-766e88a4-1bf1-40b2-973b-207808630a3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:58.522728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1030/2044] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:11:58.628424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e88a4-1bf1-40b2-973b-207808630a3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:58.705238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e88a4-1bf1-40b2-973b-207808630a3a service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:58.705238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1015/2045] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:11:59.234030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9d5a0-1330-476e-9551-77bbf3b5672d service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:59.246697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-97c9d5a0-1330-476e-9551-77bbf3b5672d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:59.262159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9d5a0-1330-476e-9551-77bbf3b5672d service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:59.267223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:59.268061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:59.268349 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:59.268632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] PATH_INFO: `/v3/projects/a6f7a829335e4ff19bd9c8d5457ff6bf` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:59.269814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f7a829335e4ff19bd9c8d5457ff6bf)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:59.295784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:59.415218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f7a829335e4ff19bd9c8d5457ff6bf', 'request_id': 'req-055d56c5-5b99-4cf1-9348-3272a86b34c9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:59.494701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f7a829335e4ff19bd9c8d5457ff6bf', 'request_id': 'req-055d56c5-5b99-4cf1-9348-3272a86b34c9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:59.508355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0c9d-f59f-43c8-b57c-fd525ebc701c None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:59.508680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0c9d-f59f-43c8-b57c-fd525ebc701c None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:59.508968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0c9d-f59f-43c8-b57c-fd525ebc701c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:59.519099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f7a829335e4ff19bd9c8d5457ff6bf', 'request_id': 'req-055d56c5-5b99-4cf1-9348-3272a86b34c9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:59.544507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] The token cache is being invalidate because project a6f7a829335e4ff19bd9c8d5457ff6bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:11:59.544642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:59.547074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:11:59.552508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1031/2046] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:11:59 2022] DELETE /identity/v3/projects/a6f7a829335e4ff19bd9c8d5457ff6bf => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:11:59.553587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:59.555031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:59.561320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ecbb0c9d-f59f-43c8-b57c-fd525ebc701c None None] MFA Rules not processed for user `61be93d2eb7e4c5d9565d812bb738223`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:11:59.562859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ecbb0c9d-f59f-43c8-b57c-fd525ebc701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:59.658616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d56c5-5b99-4cf1-9348-3272a86b34c9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:59.664030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:59.664945 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:59.665383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:59.665765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] PATH_INFO: `/v3/users/87a93edc7b5e4618a9c287913859fcd1` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:59.667004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a93edc7b5e4618a9c287913859fcd1)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:59.695932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:11:59.722089 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1016/2047] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:11:59.723030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0c9d-f59f-43c8-b57c-fd525ebc701c None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:11:59.724434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ecbb0c9d-f59f-43c8-b57c-fd525ebc701c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:11:59.740109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0c9d-f59f-43c8-b57c-fd525ebc701c None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:11:59.745989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6cdd1-1d6a-40d5-afc3-a69121c2008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:11:59.746606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6cdd1-1d6a-40d5-afc3-a69121c2008a admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:11:59.746928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6cdd1-1d6a-40d5-afc3-a69121c2008a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:11:59.747247 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6cdd1-1d6a-40d5-afc3-a69121c2008a admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:11:59.748759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6cdd1-1d6a-40d5-afc3-a69121c2008a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:11:59.784629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6cdd1-1d6a-40d5-afc3-a69121c2008a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:00.092059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1017/2048] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:11:59 2022] POST /identity/v3/projects => generated 373 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:00.092059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6cdd1-1d6a-40d5-afc3-a69121c2008a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:00.161857 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6cdd1-1d6a-40d5-afc3-a69121c2008a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:00.166017 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8d29-38d7-4e74-b819-b40064c3d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:00.166623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8d29-38d7-4e74-b819-b40064c3d19c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:00.166915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8d29-38d7-4e74-b819-b40064c3d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:00.167208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8d29-38d7-4e74-b819-b40064c3d19c admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:00.167915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8d29-38d7-4e74-b819-b40064c3d19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:00.171396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a93edc7b5e4618a9c287913859fcd1'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:00.172020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a93edc7b5e4618a9c287913859fcd1'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:00.180400 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a93edc7b5e4618a9c287913859fcd1'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:00.192635 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a93edc7b5e4618a9c287913859fcd1'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:00.196276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8d29-38d7-4e74-b819-b40064c3d19c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:00.281037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a93edc7b5e4618a9c287913859fcd1'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:00.287646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1032/2049] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:11:59 2022] DELETE /identity/v3/users/87a93edc7b5e4618a9c287913859fcd1 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:00.298884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1018/2050] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:00 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:00.304757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:00.306061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:00.390667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4e800-e258-45f4-973c-93fd05830edc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:00.395002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc20a4-e5fb-4c0c-a37a-8a8175dca175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:00.395626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc20a4-e5fb-4c0c-a37a-8a8175dca175 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:00.395919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc20a4-e5fb-4c0c-a37a-8a8175dca175 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:00.396208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc20a4-e5fb-4c0c-a37a-8a8175dca175 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:00.397198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc20a4-e5fb-4c0c-a37a-8a8175dca175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:00.426605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc20a4-e5fb-4c0c-a37a-8a8175dca175 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:00.437661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1033/2051] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:00.442090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8d29-38d7-4e74-b819-b40064c3d19c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:00.452020 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8d29-38d7-4e74-b819-b40064c3d19c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:00.456282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1ecbf-4c23-4bb7-96a9-29e9cf19840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:00.457111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1ecbf-4c23-4bb7-96a9-29e9cf19840c admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:00.457394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1ecbf-4c23-4bb7-96a9-29e9cf19840c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:00.457674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1ecbf-4c23-4bb7-96a9-29e9cf19840c admin admin] PATH_INFO: `/v3/projects/b098ed4575894784bdb1a7601d754d7c/users/0d3f05168ba44251ba6861754f18b61e/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:00.477444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1ecbf-4c23-4bb7-96a9-29e9cf19840c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b098ed4575894784bdb1a7601d754d7c, user_id=0d3f05168ba44251ba6861754f18b61e, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:00.505117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1ecbf-4c23-4bb7-96a9-29e9cf19840c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:00.620343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1019/2052] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:00 2022] PUT /identity/v3/projects/b098ed4575894784bdb1a7601d754d7c/users/0d3f05168ba44251ba6861754f18b61e/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:00.625570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc20a4-e5fb-4c0c-a37a-8a8175dca175 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:00.636022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc20a4-e5fb-4c0c-a37a-8a8175dca175 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:00.709748 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93bc1-3408-418f-a9cd-e39295e33b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:00.711112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93bc1-3408-418f-a9cd-e39295e33b77 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:00.711513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93bc1-3408-418f-a9cd-e39295e33b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:00.711787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93bc1-3408-418f-a9cd-e39295e33b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:00.712786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a93bc1-3408-418f-a9cd-e39295e33b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:00.740150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a93bc1-3408-418f-a9cd-e39295e33b77 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:00.751351 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1034/2053] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:00.755624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1ecbf-4c23-4bb7-96a9-29e9cf19840c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:00.766096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1ecbf-4c23-4bb7-96a9-29e9cf19840c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:00.770192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c28b4-8093-4572-be04-801f53e99214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:00.771001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c28b4-8093-4572-be04-801f53e99214 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:00.771285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c28b4-8093-4572-be04-801f53e99214 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:00.771594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c28b4-8093-4572-be04-801f53e99214 admin admin] PATH_INFO: `/v3/projects/b098ed4575894784bdb1a7601d754d7c/users/0d3f05168ba44251ba6861754f18b61e/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:00.773316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c28b4-8093-4572-be04-801f53e99214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b098ed4575894784bdb1a7601d754d7c, user_id=0d3f05168ba44251ba6861754f18b61e, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:00.799945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c28b4-8093-4572-be04-801f53e99214 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:00.811734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1020/2054] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:00 2022] PUT /identity/v3/projects/b098ed4575894784bdb1a7601d754d7c/users/0d3f05168ba44251ba6861754f18b61e/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:00.815789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93bc1-3408-418f-a9cd-e39295e33b77 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:00.834581 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93bc1-3408-418f-a9cd-e39295e33b77 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:00.851346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c28b4-8093-4572-be04-801f53e99214 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:00.853088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d36c28b4-8093-4572-be04-801f53e99214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:00.933326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7c13-182e-4d01-911a-4b45bd9ad9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:00.934014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7c13-182e-4d01-911a-4b45bd9ad9be admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:00.934412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7c13-182e-4d01-911a-4b45bd9ad9be admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:00.934755 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e7c13-182e-4d01-911a-4b45bd9ad9be admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:00.936408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e7c13-182e-4d01-911a-4b45bd9ad9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:00.955027 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c28b4-8093-4572-be04-801f53e99214 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:00.959520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:00.960456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:00.960762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:00.961019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] PATH_INFO: `/v3/projects/9e26ba5fa42a44a795578c11a65a0c25` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:00.962110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e26ba5fa42a44a795578c11a65a0c25)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:00.963521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e7c13-182e-4d01-911a-4b45bd9ad9be admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:00.974225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1035/2055] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:00.978252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7c13-182e-4d01-911a-4b45bd9ad9be admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:00.988875 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e7c13-182e-4d01-911a-4b45bd9ad9be admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:00.989049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:00.993249 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3795746c-9b07-49b5-ae29-a9a3bb683874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:00.994112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795746c-9b07-49b5-ae29-a9a3bb683874 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:00.994373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795746c-9b07-49b5-ae29-a9a3bb683874 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:00.994923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3795746c-9b07-49b5-ae29-a9a3bb683874 admin admin] PATH_INFO: `/v3/projects/b098ed4575894784bdb1a7601d754d7c/users/0d3f05168ba44251ba6861754f18b61e/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:00.996444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795746c-9b07-49b5-ae29-a9a3bb683874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b098ed4575894784bdb1a7601d754d7c, user_id=0d3f05168ba44251ba6861754f18b61e, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:01.023649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3795746c-9b07-49b5-ae29-a9a3bb683874 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:01.140855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1036/2056] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:00 2022] PUT /identity/v3/projects/b098ed4575894784bdb1a7601d754d7c/users/0d3f05168ba44251ba6861754f18b61e/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:01.151401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e26ba5fa42a44a795578c11a65a0c25', 'request_id': 'req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:01.259947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e26ba5fa42a44a795578c11a65a0c25', 'request_id': 'req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:01.271997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e26ba5fa42a44a795578c11a65a0c25', 'request_id': 'req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:01.282495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] The token cache is being invalidate because project 9e26ba5fa42a44a795578c11a65a0c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:01.282778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:01.283426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-108b1c2d-4e6a-4cb8-8e56-4fa65e6f5bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:01.284863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1021/2057] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:00 2022] DELETE /identity/v3/projects/9e26ba5fa42a44a795578c11a65a0c25 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:01.290923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff74dc6-cdf4-4b5b-9acb-8a7c681f9f0a None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:01.291399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff74dc6-cdf4-4b5b-9acb-8a7c681f9f0a None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:01.291512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff74dc6-cdf4-4b5b-9acb-8a7c681f9f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:01.317273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5ff74dc6-cdf4-4b5b-9acb-8a7c681f9f0a None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:01.318428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5ff74dc6-cdf4-4b5b-9acb-8a7c681f9f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:01.388238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1037/2058] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:01.396165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7145578-6094-488b-a52a-de6b8274f3d7 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:01.396713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7145578-6094-488b-a52a-de6b8274f3d7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:01.397003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7145578-6094-488b-a52a-de6b8274f3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:01.423101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-a7145578-6094-488b-a52a-de6b8274f3d7 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:01.424304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a7145578-6094-488b-a52a-de6b8274f3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:01.431722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1022/2059] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:01.435952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff74dc6-cdf4-4b5b-9acb-8a7c681f9f0a None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:01.445538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff74dc6-cdf4-4b5b-9acb-8a7c681f9f0a None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:01.449855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaded6-18ce-4953-b2af-fa5f7f1b4f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:01.450441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaded6-18ce-4953-b2af-fa5f7f1b4f35 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:01.450732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaded6-18ce-4953-b2af-fa5f7f1b4f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:01.451016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbaded6-18ce-4953-b2af-fa5f7f1b4f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:01.451738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaded6-18ce-4953-b2af-fa5f7f1b4f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:12:01.452039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaded6-18ce-4953-b2af-fa5f7f1b4f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:01.480687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbaded6-18ce-4953-b2af-fa5f7f1b4f35 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:01.495080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1038/2060] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:12:01.500324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7145578-6094-488b-a52a-de6b8274f3d7 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:01.509315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7145578-6094-488b-a52a-de6b8274f3d7 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:01.513916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a56804-1d2f-42a0-9c27-755b7e0e260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:01.514444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56804-1d2f-42a0-9c27-755b7e0e260c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:01.514729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56804-1d2f-42a0-9c27-755b7e0e260c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:01.515849 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a56804-1d2f-42a0-9c27-755b7e0e260c admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:01.516725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a56804-1d2f-42a0-9c27-755b7e0e260c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:01.543389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a56804-1d2f-42a0-9c27-755b7e0e260c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:01.684433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1023/2061] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:01 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:01.689330 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaded6-18ce-4953-b2af-fa5f7f1b4f35 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:01.698885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbaded6-18ce-4953-b2af-fa5f7f1b4f35 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:01.763123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f082441-e7f6-49fa-8d0a-5f5fa0367c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:01.763759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f082441-e7f6-49fa-8d0a-5f5fa0367c44 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:01.764102 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f082441-e7f6-49fa-8d0a-5f5fa0367c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:01.764334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f082441-e7f6-49fa-8d0a-5f5fa0367c44 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:01.764982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f082441-e7f6-49fa-8d0a-5f5fa0367c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:01.791445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f082441-e7f6-49fa-8d0a-5f5fa0367c44 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:01.944789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1039/2062] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:01 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:01.946937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a56804-1d2f-42a0-9c27-755b7e0e260c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:01.958857 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a56804-1d2f-42a0-9c27-755b7e0e260c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:01.963430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541cd9ba-dcc8-4e56-8261-62927bfc669d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:01.964044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cd9ba-dcc8-4e56-8261-62927bfc669d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:01.964474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cd9ba-dcc8-4e56-8261-62927bfc669d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:01.964594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cd9ba-dcc8-4e56-8261-62927bfc669d admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:01.965293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cd9ba-dcc8-4e56-8261-62927bfc669d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:01.992166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541cd9ba-dcc8-4e56-8261-62927bfc669d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:02.007279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1024/2063] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:02.008035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f082441-e7f6-49fa-8d0a-5f5fa0367c44 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:02.018938 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f082441-e7f6-49fa-8d0a-5f5fa0367c44 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:02.023204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625bce7-907f-422d-a00c-e5983c74f424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:02.024124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625bce7-907f-422d-a00c-e5983c74f424 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:02.024530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625bce7-907f-422d-a00c-e5983c74f424 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:02.024896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625bce7-907f-422d-a00c-e5983c74f424 admin admin] PATH_INFO: `/v3/projects/e20d96faf48c49d2a7669428ee3aa3fc/users/227ca3ad3eb64efeb7911195def9b45a/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:02.045757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625bce7-907f-422d-a00c-e5983c74f424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20d96faf48c49d2a7669428ee3aa3fc, user_id=227ca3ad3eb64efeb7911195def9b45a, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:02.081574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625bce7-907f-422d-a00c-e5983c74f424 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:02.197903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1040/2064] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:02 2022] PUT /identity/v3/projects/e20d96faf48c49d2a7669428ee3aa3fc/users/227ca3ad3eb64efeb7911195def9b45a/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:02.209434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8ad2-20b5-42ab-bc8d-c79c5df526be None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:02.209728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8ad2-20b5-42ab-bc8d-c79c5df526be None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:02.210010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a8ad2-20b5-42ab-bc8d-c79c5df526be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:02.251658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-5d0a8ad2-20b5-42ab-bc8d-c79c5df526be None None] MFA Rules not processed for user `227ca3ad3eb64efeb7911195def9b45a`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:02.251658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5d0a8ad2-20b5-42ab-bc8d-c79c5df526be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:02.326196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1025/2065] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:02.331268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625bce7-907f-422d-a00c-e5983c74f424 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:02.401930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625bce7-907f-422d-a00c-e5983c74f424 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:02.410819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9f119-278d-4cae-b80a-569f4e83724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:02.411072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9f119-278d-4cae-b80a-569f4e83724d admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:02.411399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9f119-278d-4cae-b80a-569f4e83724d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:02.411725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9f119-278d-4cae-b80a-569f4e83724d admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:02.412349 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9f119-278d-4cae-b80a-569f4e83724d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:02.438561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9f119-278d-4cae-b80a-569f4e83724d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:02.560147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1041/2066] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:02 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:02.561334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8ad2-20b5-42ab-bc8d-c79c5df526be None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:02.572028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a8ad2-20b5-42ab-bc8d-c79c5df526be None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:02.636625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da182fd-4454-45ed-a473-0df4cb04e5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:02.637229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da182fd-4454-45ed-a473-0df4cb04e5af admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:02.637511 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da182fd-4454-45ed-a473-0df4cb04e5af admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:02.637788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da182fd-4454-45ed-a473-0df4cb04e5af admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:02.638420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da182fd-4454-45ed-a473-0df4cb04e5af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:02.675278 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da182fd-4454-45ed-a473-0df4cb04e5af admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:02.798967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1026/2067] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:02 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:02.802597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9f119-278d-4cae-b80a-569f4e83724d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:02.813632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9f119-278d-4cae-b80a-569f4e83724d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:02.822275 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762efd-4032-4466-b9e9-e259135ffca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:02.822989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762efd-4032-4466-b9e9-e259135ffca5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:02.823389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762efd-4032-4466-b9e9-e259135ffca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:02.823677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762efd-4032-4466-b9e9-e259135ffca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:02.824384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d762efd-4032-4466-b9e9-e259135ffca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:02.852177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d762efd-4032-4466-b9e9-e259135ffca5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:02.865784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1042/2068] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:12:02.869883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da182fd-4454-45ed-a473-0df4cb04e5af admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:02.880764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da182fd-4454-45ed-a473-0df4cb04e5af admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:02.885170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e62b31-5439-4653-934b-5c32d39bcdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:02.885995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e62b31-5439-4653-934b-5c32d39bcdc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:02.886284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e62b31-5439-4653-934b-5c32d39bcdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:02.886571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e62b31-5439-4653-934b-5c32d39bcdc9 admin admin] PATH_INFO: `/v3/projects/f9079b67178c41d182f928b666888226/users/b41c0f49c5974b01853f513658de1700/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:02.909080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e62b31-5439-4653-934b-5c32d39bcdc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9079b67178c41d182f928b666888226, user_id=b41c0f49c5974b01853f513658de1700, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:02.935913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e62b31-5439-4653-934b-5c32d39bcdc9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:02.958146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2296e-ea8e-4e5f-9ac7-af4220ca2f1b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:02.958449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2296e-ea8e-4e5f-9ac7-af4220ca2f1b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:02.958738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2296e-ea8e-4e5f-9ac7-af4220ca2f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:02.998165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-63d2296e-ea8e-4e5f-9ac7-af4220ca2f1b None None] MFA Rules not processed for user `0d3f05168ba44251ba6861754f18b61e`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:02.999641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-63d2296e-ea8e-4e5f-9ac7-af4220ca2f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:03.033775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1027/2069] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:02 2022] PUT /identity/v3/projects/f9079b67178c41d182f928b666888226/users/b41c0f49c5974b01853f513658de1700/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:03.037378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e62b31-5439-4653-934b-5c32d39bcdc9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:03.162209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e62b31-5439-4653-934b-5c32d39bcdc9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:03.166737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4d478-6f56-40da-ad36-9df8606b4fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:03.167385 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4d478-6f56-40da-ad36-9df8606b4fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:03.167676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4d478-6f56-40da-ad36-9df8606b4fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:03.167974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4d478-6f56-40da-ad36-9df8606b4fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:03.168674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4d478-6f56-40da-ad36-9df8606b4fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:03.197070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4d478-6f56-40da-ad36-9df8606b4fa5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:03.211628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1028/2070] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:03.211819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1043/2071] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:03.216266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4d478-6f56-40da-ad36-9df8606b4fa5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:03.219694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2296e-ea8e-4e5f-9ac7-af4220ca2f1b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:03.221083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-63d2296e-ea8e-4e5f-9ac7-af4220ca2f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:03.226521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4d478-6f56-40da-ad36-9df8606b4fa5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:03.231298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed37ea2-260d-43e7-add1-4aa16465d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:03.232160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed37ea2-260d-43e7-add1-4aa16465d3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:03.232445 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed37ea2-260d-43e7-add1-4aa16465d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:03.232725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed37ea2-260d-43e7-add1-4aa16465d3cd admin admin] PATH_INFO: `/v3/projects/f9079b67178c41d182f928b666888226/users/b41c0f49c5974b01853f513658de1700/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:03.235416 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed37ea2-260d-43e7-add1-4aa16465d3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9079b67178c41d182f928b666888226, user_id=b41c0f49c5974b01853f513658de1700, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:03.265128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed37ea2-260d-43e7-add1-4aa16465d3cd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:03.276413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1029/2072] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:03 2022] PUT /identity/v3/projects/f9079b67178c41d182f928b666888226/users/b41c0f49c5974b01853f513658de1700/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:03.280748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed37ea2-260d-43e7-add1-4aa16465d3cd admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:03.289256 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2296e-ea8e-4e5f-9ac7-af4220ca2f1b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:03.357786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e2b02-81ba-49a6-91e8-2cf5f980fe4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:03.358639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e2b02-81ba-49a6-91e8-2cf5f980fe4c service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:03.359593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e2b02-81ba-49a6-91e8-2cf5f980fe4c service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:03.360073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e2b02-81ba-49a6-91e8-2cf5f980fe4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:03.364178 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-314e2b02-81ba-49a6-91e8-2cf5f980fe4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:03.365744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed37ea2-260d-43e7-add1-4aa16465d3cd admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:03.376149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2decc-9c89-4f4d-ab7a-decc43738af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:03.376771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2decc-9c89-4f4d-ab7a-decc43738af3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:03.377057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2decc-9c89-4f4d-ab7a-decc43738af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:03.377337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2decc-9c89-4f4d-ab7a-decc43738af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:03.378031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2decc-9c89-4f4d-ab7a-decc43738af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:03.404136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2decc-9c89-4f4d-ab7a-decc43738af3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:03.414857 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1030/2073] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:12:03.419068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2decc-9c89-4f4d-ab7a-decc43738af3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:03.429436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2decc-9c89-4f4d-ab7a-decc43738af3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:03.433703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb571-9dc0-4cf8-8327-3d2b97a2d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:03.439145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb571-9dc0-4cf8-8327-3d2b97a2d17b admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:03.439145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb571-9dc0-4cf8-8327-3d2b97a2d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:03.439145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2bb571-9dc0-4cf8-8327-3d2b97a2d17b admin admin] PATH_INFO: `/v3/projects/f9079b67178c41d182f928b666888226/users/b41c0f49c5974b01853f513658de1700/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:03.439145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bb571-9dc0-4cf8-8327-3d2b97a2d17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9079b67178c41d182f928b666888226, user_id=b41c0f49c5974b01853f513658de1700, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:03.439510 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e2b02-81ba-49a6-91e8-2cf5f980fe4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:03.464539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e2b02-81ba-49a6-91e8-2cf5f980fe4c service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:03.464778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2bb571-9dc0-4cf8-8327-3d2b97a2d17b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:03.475095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1044/2074] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:12:03.526727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1031/2075] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:03 2022] PUT /identity/v3/projects/f9079b67178c41d182f928b666888226/users/b41c0f49c5974b01853f513658de1700/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:03.538102 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef560e4-0a07-4856-af2a-b7c2c97e29b9 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:03.538404 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef560e4-0a07-4856-af2a-b7c2c97e29b9 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:03.538699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef560e4-0a07-4856-af2a-b7c2c97e29b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:03.576990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-eef560e4-0a07-4856-af2a-b7c2c97e29b9 None None] MFA Rules not processed for user `b41c0f49c5974b01853f513658de1700`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:03.578198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-eef560e4-0a07-4856-af2a-b7c2c97e29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:03.659777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1045/2076] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:03 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:03.669275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb571-9dc0-4cf8-8327-3d2b97a2d17b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:03.671891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ef2bb571-9dc0-4cf8-8327-3d2b97a2d17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:03.737222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2bb571-9dc0-4cf8-8327-3d2b97a2d17b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:03.740648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5177-911d-4189-9da7-ab5295e16ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:03.741230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5177-911d-4189-9da7-ab5295e16ace service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:03.741512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5177-911d-4189-9da7-ab5295e16ace service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:03.741795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e5177-911d-4189-9da7-ab5295e16ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:03.821137 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e5177-911d-4189-9da7-ab5295e16ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:03.847840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e5177-911d-4189-9da7-ab5295e16ace service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:03.857706 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1032/2077] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:03 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:09.854071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef560e4-0a07-4856-af2a-b7c2c97e29b9 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:09.864835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef560e4-0a07-4856-af2a-b7c2c97e29b9 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:09.868343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ac4d8-ad9c-495f-9f69-2e94e237b8c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:09.868925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac4d8-ad9c-495f-9f69-2e94e237b8c7 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:09.869236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac4d8-ad9c-495f-9f69-2e94e237b8c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:09.869516 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ac4d8-ad9c-495f-9f69-2e94e237b8c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:09.943873 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ac4d8-ad9c-495f-9f69-2e94e237b8c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:09.970140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ac4d8-ad9c-495f-9f69-2e94e237b8c7 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:09.979537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1046/2078] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:09 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:10.790038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5177-911d-4189-9da7-ab5295e16ace service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:10.871161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e5177-911d-4189-9da7-ab5295e16ace service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:10.876899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:10.881290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:10.881290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:10.881290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] PATH_INFO: `/v3/users/227ca3ad3eb64efeb7911195def9b45a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:10.881290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227ca3ad3eb64efeb7911195def9b45a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:10.908553 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:11.233440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227ca3ad3eb64efeb7911195def9b45a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:11.246930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227ca3ad3eb64efeb7911195def9b45a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:11.247740 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227ca3ad3eb64efeb7911195def9b45a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:11.255855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227ca3ad3eb64efeb7911195def9b45a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:11.337945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227ca3ad3eb64efeb7911195def9b45a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:11.345443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1033/2079] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:10 2022] DELETE /identity/v3/users/227ca3ad3eb64efeb7911195def9b45a => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:11.349963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7599-5e7e-4bdc-8083-bf24f9c52891 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:11.350462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7599-5e7e-4bdc-8083-bf24f9c52891 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:11.350551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b7599-5e7e-4bdc-8083-bf24f9c52891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:11.373544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a18b7599-5e7e-4bdc-8083-bf24f9c52891 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:11.376045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a18b7599-5e7e-4bdc-8083-bf24f9c52891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:11.466534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1047/2080] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:11 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:11.478522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:11.480082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:11.571694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece7350-cab8-4627-acb9-fbbbcfa645c0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:11.575708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1b4ef-7255-4837-a2de-3555ef15011d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:11.576312 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1b4ef-7255-4837-a2de-3555ef15011d service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:11.576629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1b4ef-7255-4837-a2de-3555ef15011d service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:11.576917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1b4ef-7255-4837-a2de-3555ef15011d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:11.587803 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1b4ef-7255-4837-a2de-3555ef15011d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:11.614826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1b4ef-7255-4837-a2de-3555ef15011d service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:11.625673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1034/2081] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:11 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:12.306557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7599-5e7e-4bdc-8083-bf24f9c52891 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:12.308048 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a18b7599-5e7e-4bdc-8083-bf24f9c52891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:12.325165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b7599-5e7e-4bdc-8083-bf24f9c52891 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:12.331615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:12.333604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:12.334245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:12.334723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] PATH_INFO: `/v3/projects/e20d96faf48c49d2a7669428ee3aa3fc` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:12.335997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20d96faf48c49d2a7669428ee3aa3fc)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:12.367554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:12.536226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20d96faf48c49d2a7669428ee3aa3fc', 'request_id': 'req-d5627550-cd0b-452e-a964-062c6b78b060'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:12.626065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20d96faf48c49d2a7669428ee3aa3fc', 'request_id': 'req-d5627550-cd0b-452e-a964-062c6b78b060'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:12.638033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20d96faf48c49d2a7669428ee3aa3fc', 'request_id': 'req-d5627550-cd0b-452e-a964-062c6b78b060'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:12.650561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] The token cache is being invalidate because project e20d96faf48c49d2a7669428ee3aa3fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:12.650855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:12.651539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:12.653420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1048/2082] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:12 2022] DELETE /identity/v3/projects/e20d96faf48c49d2a7669428ee3aa3fc => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:12.659248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1b4ef-7255-4837-a2de-3555ef15011d service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:12.669573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1b4ef-7255-4837-a2de-3555ef15011d service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:12.731641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:12.732449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:12.732732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:12.733009 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] PATH_INFO: `/v3/users/b41c0f49c5974b01853f513658de1700` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:12.734813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41c0f49c5974b01853f513658de1700)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:12.760244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:13.065211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:13.066780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:13.089191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5627550-cd0b-452e-a964-062c6b78b060 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:13.101598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:13.102696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:13.103184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:13.103691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] PATH_INFO: `/v3/users/849bb42032844d6e9df9847c3a80385c` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:13.108572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849bb42032844d6e9df9847c3a80385c)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:13.166371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:13.226094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41c0f49c5974b01853f513658de1700'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.243422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41c0f49c5974b01853f513658de1700'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.244138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41c0f49c5974b01853f513658de1700'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.254639 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41c0f49c5974b01853f513658de1700'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.408809 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-395b3082-8ff3-439c-b7ba-995962a9263b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41c0f49c5974b01853f513658de1700'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.418471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1035/2083] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:12 2022] DELETE /identity/v3/users/b41c0f49c5974b01853f513658de1700 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:13.516817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849bb42032844d6e9df9847c3a80385c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.518391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849bb42032844d6e9df9847c3a80385c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.528843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849bb42032844d6e9df9847c3a80385c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.546669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849bb42032844d6e9df9847c3a80385c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.646438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849bb42032844d6e9df9847c3a80385c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:13.653216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1049/2084] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:13 2022] DELETE /identity/v3/users/849bb42032844d6e9df9847c3a80385c => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:13.658606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edad39-3d2f-4841-9523-a6d532e319d4 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:13.658901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edad39-3d2f-4841-9523-a6d532e319d4 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:13.659241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edad39-3d2f-4841-9523-a6d532e319d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:13.681827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-74edad39-3d2f-4841-9523-a6d532e319d4 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:13.682971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-74edad39-3d2f-4841-9523-a6d532e319d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:13.752273 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1036/2085] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:13.764456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:13.766803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:13.837844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef457f24-d56f-4d11-ac1c-8e552f9edf18 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:13.841303 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60352f9c-732b-498f-ae83-a4df26168ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:13.841883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352f9c-732b-498f-ae83-a4df26168ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:13.842171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352f9c-732b-498f-ae83-a4df26168ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:13.842453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60352f9c-732b-498f-ae83-a4df26168ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:13.859958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352f9c-732b-498f-ae83-a4df26168ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:13.882270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60352f9c-732b-498f-ae83-a4df26168ad2 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:13.892616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1050/2086] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:13 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:14.048684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edad39-3d2f-4841-9523-a6d532e319d4 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:14.052842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-74edad39-3d2f-4841-9523-a6d532e319d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:14.070876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edad39-3d2f-4841-9523-a6d532e319d4 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:14.075851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:14.076772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:14.077151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:14.077522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] PATH_INFO: `/v3/projects/f9079b67178c41d182f928b666888226` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:14.078856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9079b67178c41d182f928b666888226)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:14.106007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:14.255824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9079b67178c41d182f928b666888226', 'request_id': 'req-d9d06381-e508-46c9-933b-72f4a10fbfec'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.323924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9079b67178c41d182f928b666888226', 'request_id': 'req-d9d06381-e508-46c9-933b-72f4a10fbfec'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.340237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9079b67178c41d182f928b666888226', 'request_id': 'req-d9d06381-e508-46c9-933b-72f4a10fbfec'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.363777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] The token cache is being invalidate because project f9079b67178c41d182f928b666888226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:14.364084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.364729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d9d06381-e508-46c9-933b-72f4a10fbfec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.371346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1037/2087] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:14 2022] DELETE /identity/v3/projects/f9079b67178c41d182f928b666888226 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:14.372436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4540eb-3068-4b49-b0a7-f1dc51e1e1b3 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:14.372954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4540eb-3068-4b49-b0a7-f1dc51e1e1b3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:14.373453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4540eb-3068-4b49-b0a7-f1dc51e1e1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:14.405796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-8d4540eb-3068-4b49-b0a7-f1dc51e1e1b3 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:14.407681 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-8d4540eb-3068-4b49-b0a7-f1dc51e1e1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:14.479114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1051/2088] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:14.487426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042304ef-96cd-4dff-881f-c7da1d0da8aa None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:14.487802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042304ef-96cd-4dff-881f-c7da1d0da8aa None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:14.488154 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042304ef-96cd-4dff-881f-c7da1d0da8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:14.511754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-042304ef-96cd-4dff-881f-c7da1d0da8aa None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:14.512924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-042304ef-96cd-4dff-881f-c7da1d0da8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:14.528919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1038/2089] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:14.534851 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4540eb-3068-4b49-b0a7-f1dc51e1e1b3 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:14.548204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4540eb-3068-4b49-b0a7-f1dc51e1e1b3 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:14.552790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2129dbf-e347-467b-9a68-b911c342c8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:14.555405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2129dbf-e347-467b-9a68-b911c342c8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:14.555784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2129dbf-e347-467b-9a68-b911c342c8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:14.556316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2129dbf-e347-467b-9a68-b911c342c8b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:14.557035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2129dbf-e347-467b-9a68-b911c342c8b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:12:14.557347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2129dbf-e347-467b-9a68-b911c342c8b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:14.565665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042304ef-96cd-4dff-881f-c7da1d0da8aa None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:14.572432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-042304ef-96cd-4dff-881f-c7da1d0da8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:14.586066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2129dbf-e347-467b-9a68-b911c342c8b2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:14.596821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042304ef-96cd-4dff-881f-c7da1d0da8aa None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:14.604180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:14.604702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1052/2090] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:12:14.604963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:14.605624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:14.605941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] PATH_INFO: `/v3/projects/9a28518dc0894d7bab06418ca3b1124f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:14.607518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a28518dc0894d7bab06418ca3b1124f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:14.608542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2129dbf-e347-467b-9a68-b911c342c8b2 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:14.619361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2129dbf-e347-467b-9a68-b911c342c8b2 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:14.623864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cdf22-6761-47a5-a6bf-21abd205b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:14.624451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cdf22-6761-47a5-a6bf-21abd205b95c admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:14.624738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cdf22-6761-47a5-a6bf-21abd205b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:14.625015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cdf22-6761-47a5-a6bf-21abd205b95c admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:14.625712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cdf22-6761-47a5-a6bf-21abd205b95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:14.649335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:14.654073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cdf22-6761-47a5-a6bf-21abd205b95c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:14.762278 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1053/2091] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:14 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:14.767915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cdf22-6761-47a5-a6bf-21abd205b95c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:14.809073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a28518dc0894d7bab06418ca3b1124f', 'request_id': 'req-eb0d5b77-e159-43ed-8edb-e79dc00d447e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.843821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cdf22-6761-47a5-a6bf-21abd205b95c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:14.886499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a28518dc0894d7bab06418ca3b1124f', 'request_id': 'req-eb0d5b77-e159-43ed-8edb-e79dc00d447e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.898985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a28518dc0894d7bab06418ca3b1124f', 'request_id': 'req-eb0d5b77-e159-43ed-8edb-e79dc00d447e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.910010 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312efb-bd70-4cf2-86fc-da0084bb52bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:14.910556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312efb-bd70-4cf2-86fc-da0084bb52bd admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:14.910699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] The token cache is being invalidate because project 9a28518dc0894d7bab06418ca3b1124f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:14.910850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312efb-bd70-4cf2-86fc-da0084bb52bd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:14.910966 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.911145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6312efb-bd70-4cf2-86fc-da0084bb52bd admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:14.911517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:14.911887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6312efb-bd70-4cf2-86fc-da0084bb52bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:14.912950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1039/2092] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:14 2022] DELETE /identity/v3/projects/9a28518dc0894d7bab06418ca3b1124f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:14.918711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:14.920059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:14.932635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d5b77-e159-43ed-8edb-e79dc00d447e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:14.936910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:14.937757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:14.938663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:14.939056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] PATH_INFO: `/v3/users/a99654d240924319b7564e1a4b74c8e1` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:14.940257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99654d240924319b7564e1a4b74c8e1)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:14.947029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6312efb-bd70-4cf2-86fc-da0084bb52bd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:14.966433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:15.034228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1054/2093] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:14 2022] POST /identity/v3/users => generated 287 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:15.040226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312efb-bd70-4cf2-86fc-da0084bb52bd admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:15.041807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a6312efb-bd70-4cf2-86fc-da0084bb52bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:15.108073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6312efb-bd70-4cf2-86fc-da0084bb52bd admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:15.112813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:15.113396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:15.113659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:15.113939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:15.115673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:15.181793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:15.197080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99654d240924319b7564e1a4b74c8e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:15.208016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:15.209112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99654d240924319b7564e1a4b74c8e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:15.209737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99654d240924319b7564e1a4b74c8e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:15.217256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99654d240924319b7564e1a4b74c8e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:15.217504 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1055/2094] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:15 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:15.218520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:15.220375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:15.233632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00267553-e8e6-4b54-8152-188b93559619 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:15.238804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f83a53-b679-4b34-822d-a4d0138abc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:15.239433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f83a53-b679-4b34-822d-a4d0138abc7f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:15.239765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f83a53-b679-4b34-822d-a4d0138abc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:15.240046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f83a53-b679-4b34-822d-a4d0138abc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:15.240730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f83a53-b679-4b34-822d-a4d0138abc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:15.267065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f83a53-b679-4b34-822d-a4d0138abc7f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:15.278062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1056/2095] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:15.282374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f83a53-b679-4b34-822d-a4d0138abc7f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:15.291975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f83a53-b679-4b34-822d-a4d0138abc7f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:15.296201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24207d-e2c4-4921-93a6-14593924df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:15.297042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24207d-e2c4-4921-93a6-14593924df1d admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:15.297331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24207d-e2c4-4921-93a6-14593924df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:15.298253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24207d-e2c4-4921-93a6-14593924df1d admin admin] PATH_INFO: `/v3/projects/5eb3e9233b3440c1a7481e0c73a04645/users/e33c16ce9b7c4f3ca249db2760fa4e12/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:15.320234 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24207d-e2c4-4921-93a6-14593924df1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb3e9233b3440c1a7481e0c73a04645, user_id=e33c16ce9b7c4f3ca249db2760fa4e12, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:15.322398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6440db24-294a-4aad-9d2c-7d5540d828af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99654d240924319b7564e1a4b74c8e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:15.329769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1040/2096] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:14 2022] DELETE /identity/v3/users/a99654d240924319b7564e1a4b74c8e1 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:15.355500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e24207d-e2c4-4921-93a6-14593924df1d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:15.465865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1057/2097] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:15 2022] PUT /identity/v3/projects/5eb3e9233b3440c1a7481e0c73a04645/users/e33c16ce9b7c4f3ca249db2760fa4e12/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:15.477246 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935a471-adc3-4c5d-8234-840673185336 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:15.477550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935a471-adc3-4c5d-8234-840673185336 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:15.477828 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935a471-adc3-4c5d-8234-840673185336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:15.514613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-7935a471-adc3-4c5d-8234-840673185336 None None] MFA Rules not processed for user `e33c16ce9b7c4f3ca249db2760fa4e12`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:15.515792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7935a471-adc3-4c5d-8234-840673185336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:15.602309 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1041/2098] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:15.606813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24207d-e2c4-4921-93a6-14593924df1d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:15.609284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-6e24207d-e2c4-4921-93a6-14593924df1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:15.704570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24207d-e2c4-4921-93a6-14593924df1d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:15.709009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2a944-a470-4ee5-b763-7ffad9862dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:15.709600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2a944-a470-4ee5-b763-7ffad9862dac admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:15.709955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2a944-a470-4ee5-b763-7ffad9862dac admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:15.710180 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2a944-a470-4ee5-b763-7ffad9862dac admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:15.710823 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2a944-a470-4ee5-b763-7ffad9862dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:15.738702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2a944-a470-4ee5-b763-7ffad9862dac admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:15.928507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1058/2099] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:15 2022] POST /identity/v3/projects => generated 375 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:15.932862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935a471-adc3-4c5d-8234-840673185336 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:15.943149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935a471-adc3-4c5d-8234-840673185336 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:16.009687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235249ea-9cc9-4538-8bd6-a21c5fa14e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:16.010369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235249ea-9cc9-4538-8bd6-a21c5fa14e5e admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.010730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235249ea-9cc9-4538-8bd6-a21c5fa14e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.011080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235249ea-9cc9-4538-8bd6-a21c5fa14e5e admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.012074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235249ea-9cc9-4538-8bd6-a21c5fa14e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:16.029058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2a944-a470-4ee5-b763-7ffad9862dac admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:16.030948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-38c2a944-a470-4ee5-b763-7ffad9862dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:16.044491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235249ea-9cc9-4538-8bd6-a21c5fa14e5e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:16.047726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2a944-a470-4ee5-b763-7ffad9862dac admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:16.055720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:16.057800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.058153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.058448 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] PATH_INFO: `/v3/projects/eeb2698f3d6b46a99ed1532252bacb13` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.060433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb2698f3d6b46a99ed1532252bacb13)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:16.088480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:16.151202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1042/2100] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:15 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:16.155692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235249ea-9cc9-4538-8bd6-a21c5fa14e5e admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:16.166897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235249ea-9cc9-4538-8bd6-a21c5fa14e5e admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:16.171252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be91355-c298-49b6-9acd-e1c8b2f80d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:16.171880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be91355-c298-49b6-9acd-e1c8b2f80d3f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.172173 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be91355-c298-49b6-9acd-e1c8b2f80d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.172588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be91355-c298-49b6-9acd-e1c8b2f80d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.173284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be91355-c298-49b6-9acd-e1c8b2f80d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:16.200287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be91355-c298-49b6-9acd-e1c8b2f80d3f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:16.213395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1043/2101] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:12:16.217727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be91355-c298-49b6-9acd-e1c8b2f80d3f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:16.233593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb2698f3d6b46a99ed1532252bacb13', 'request_id': 'req-93d3896a-799a-46c5-a0de-c1a51e497b7e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:16.234329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be91355-c298-49b6-9acd-e1c8b2f80d3f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:16.300521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135c19a-c2d5-43a8-b19f-c12118f63f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:16.301344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135c19a-c2d5-43a8-b19f-c12118f63f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.301628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135c19a-c2d5-43a8-b19f-c12118f63f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.301910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135c19a-c2d5-43a8-b19f-c12118f63f51 admin admin] PATH_INFO: `/v3/projects/1f5f8066e3924631917a64fca1cb9d16/users/7ca59b9efcb845188c94e090ad720410/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.305424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb2698f3d6b46a99ed1532252bacb13', 'request_id': 'req-93d3896a-799a-46c5-a0de-c1a51e497b7e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:16.317816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb2698f3d6b46a99ed1532252bacb13', 'request_id': 'req-93d3896a-799a-46c5-a0de-c1a51e497b7e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:16.322111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135c19a-c2d5-43a8-b19f-c12118f63f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5f8066e3924631917a64fca1cb9d16, user_id=7ca59b9efcb845188c94e090ad720410, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:16.327913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] The token cache is being invalidate because project eeb2698f3d6b46a99ed1532252bacb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:16.328201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:16.329379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-93d3896a-799a-46c5-a0de-c1a51e497b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:16.330858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1059/2102] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:16 2022] DELETE /identity/v3/projects/eeb2698f3d6b46a99ed1532252bacb13 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:16.336961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af1166-205e-4c7e-8f0e-5eb8f5e0f472 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.337435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af1166-205e-4c7e-8f0e-5eb8f5e0f472 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.337725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af1166-205e-4c7e-8f0e-5eb8f5e0f472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.351397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135c19a-c2d5-43a8-b19f-c12118f63f51 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:16.361028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-27af1166-205e-4c7e-8f0e-5eb8f5e0f472 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:16.361237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-27af1166-205e-4c7e-8f0e-5eb8f5e0f472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:16.369521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1060/2103] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:16.378148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8c8a-03e9-4832-bb62-84d6d9f3a123 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.378476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8c8a-03e9-4832-bb62-84d6d9f3a123 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.378776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8c8a-03e9-4832-bb62-84d6d9f3a123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.402524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-68bc8c8a-03e9-4832-bb62-84d6d9f3a123 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:16.403868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-68bc8c8a-03e9-4832-bb62-84d6d9f3a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:16.411224 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1061/2104] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:16.415277 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8c8a-03e9-4832-bb62-84d6d9f3a123 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:16.424028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8c8a-03e9-4832-bb62-84d6d9f3a123 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:16.428531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b2e72-a106-412a-8b88-200cec073a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:16.428980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b2e72-a106-412a-8b88-200cec073a6c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.429268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b2e72-a106-412a-8b88-200cec073a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.429552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b2e72-a106-412a-8b88-200cec073a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.430230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b2e72-a106-412a-8b88-200cec073a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:12:16.430532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b2e72-a106-412a-8b88-200cec073a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:16.452450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1044/2105] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:16 2022] PUT /identity/v3/projects/1f5f8066e3924631917a64fca1cb9d16/users/7ca59b9efcb845188c94e090ad720410/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:16.457451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b2e72-a106-412a-8b88-200cec073a6c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:16.463436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cd0e2-d00f-475a-bfca-86737cadc777 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.463728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cd0e2-d00f-475a-bfca-86737cadc777 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.464008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cd0e2-d00f-475a-bfca-86737cadc777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.475627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1062/2106] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:12:16.476421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b2e72-a106-412a-8b88-200cec073a6c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:16.488020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b2e72-a106-412a-8b88-200cec073a6c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:16.514028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-5a7cd0e2-d00f-475a-bfca-86737cadc777 None None] MFA Rules not processed for user `7ca59b9efcb845188c94e090ad720410`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:16.515911 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5a7cd0e2-d00f-475a-bfca-86737cadc777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:16.559761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bf9fa-44e5-4e02-a2d3-fac9c89ec8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:16.560589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bf9fa-44e5-4e02-a2d3-fac9c89ec8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.560973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bf9fa-44e5-4e02-a2d3-fac9c89ec8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.561354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bf9fa-44e5-4e02-a2d3-fac9c89ec8c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.562215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bf9fa-44e5-4e02-a2d3-fac9c89ec8c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:16.598387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bf9fa-44e5-4e02-a2d3-fac9c89ec8c9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:16.603412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1045/2107] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:16 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:16.610640 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cd0e2-d00f-475a-bfca-86737cadc777 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:16.611935 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5a7cd0e2-d00f-475a-bfca-86737cadc777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:16.624942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cd0e2-d00f-475a-bfca-86737cadc777 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:16.631689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215449cc-f669-46a1-80c8-96f4efa1505b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:16.632289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215449cc-f669-46a1-80c8-96f4efa1505b admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.634267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215449cc-f669-46a1-80c8-96f4efa1505b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.634267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215449cc-f669-46a1-80c8-96f4efa1505b admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.634267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215449cc-f669-46a1-80c8-96f4efa1505b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:16.660180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215449cc-f669-46a1-80c8-96f4efa1505b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:16.700627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1063/2108] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:16.705811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bf9fa-44e5-4e02-a2d3-fac9c89ec8c9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:16.767038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1046/2109] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:16 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:16.771048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215449cc-f669-46a1-80c8-96f4efa1505b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:16.789325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bf9fa-44e5-4e02-a2d3-fac9c89ec8c9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:16.866527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda5aa-e68a-4a93-80df-cd6b2faf7e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:16.866527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda5aa-e68a-4a93-80df-cd6b2faf7e72 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.866527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda5aa-e68a-4a93-80df-cd6b2faf7e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.866527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afda5aa-e68a-4a93-80df-cd6b2faf7e72 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.866879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afda5aa-e68a-4a93-80df-cd6b2faf7e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:16.873602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215449cc-f669-46a1-80c8-96f4efa1505b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:16.881495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c5dcc-1215-4de5-9e4d-e086f893eb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:16.881495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c5dcc-1215-4de5-9e4d-e086f893eb58 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:16.881495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c5dcc-1215-4de5-9e4d-e086f893eb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:16.881495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c5dcc-1215-4de5-9e4d-e086f893eb58 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:16.882407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c5dcc-1215-4de5-9e4d-e086f893eb58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:16.893647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afda5aa-e68a-4a93-80df-cd6b2faf7e72 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:16.908993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c5dcc-1215-4de5-9e4d-e086f893eb58 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.056782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1064/2110] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:16 2022] POST /identity/v3/users => generated 287 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:17.060454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda5aa-e68a-4a93-80df-cd6b2faf7e72 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:17.062702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1047/2111] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:16 2022] POST /identity/v3/users => generated 294 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:17.065020 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c5dcc-1215-4de5-9e4d-e086f893eb58 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:17.073107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afda5aa-e68a-4a93-80df-cd6b2faf7e72 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:17.075033 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c5dcc-1215-4de5-9e4d-e086f893eb58 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:17.078058 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a49d-3da5-4ae9-90b4-1e37b91d9067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:17.078657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a49d-3da5-4ae9-90b4-1e37b91d9067 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.078942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a49d-3da5-4ae9-90b4-1e37b91d9067 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.079229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4a49d-3da5-4ae9-90b4-1e37b91d9067 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.079969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4a49d-3da5-4ae9-90b4-1e37b91d9067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:17.080108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c94c3c-0e91-4b70-9b85-f7a83322bca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:17.080579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c94c3c-0e91-4b70-9b85-f7a83322bca1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.080867 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c94c3c-0e91-4b70-9b85-f7a83322bca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.081231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c94c3c-0e91-4b70-9b85-f7a83322bca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.082089 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c94c3c-0e91-4b70-9b85-f7a83322bca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:17.106472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4a49d-3da5-4ae9-90b4-1e37b91d9067 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.109271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c94c3c-0e91-4b70-9b85-f7a83322bca1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.118619 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1065/2112] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:17.122532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a49d-3da5-4ae9-90b4-1e37b91d9067 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:17.124320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1048/2113] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:17.129251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c94c3c-0e91-4b70-9b85-f7a83322bca1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:17.132987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4a49d-3da5-4ae9-90b4-1e37b91d9067 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:17.139760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f1759-8b47-44c4-bc64-6e0ffd4ac6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:17.139760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f1759-8b47-44c4-bc64-6e0ffd4ac6af admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.139760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f1759-8b47-44c4-bc64-6e0ffd4ac6af admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.139760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f1759-8b47-44c4-bc64-6e0ffd4ac6af admin admin] PATH_INFO: `/v3/projects/232a88acedbc4c3981f4a68cd5572c9e/users/8415aa9435a543bbb93756ba5f706152/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.142135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c94c3c-0e91-4b70-9b85-f7a83322bca1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:17.146662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb7bb8-7bd3-497c-a8f2-a86d4d723bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:17.147505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb7bb8-7bd3-497c-a8f2-a86d4d723bde admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.147793 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb7bb8-7bd3-497c-a8f2-a86d4d723bde admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.148072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb7bb8-7bd3-497c-a8f2-a86d4d723bde admin admin] PATH_INFO: `/v3/projects/46d80edbd53247d584b24c763793e376/users/642bee02791a4f50a25aceb077eb2232/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.163657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f1759-8b47-44c4-bc64-6e0ffd4ac6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=232a88acedbc4c3981f4a68cd5572c9e, user_id=8415aa9435a543bbb93756ba5f706152, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:17.169477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb7bb8-7bd3-497c-a8f2-a86d4d723bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d80edbd53247d584b24c763793e376, user_id=642bee02791a4f50a25aceb077eb2232, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:17.192162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f1759-8b47-44c4-bc64-6e0ffd4ac6af admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.196678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb7bb8-7bd3-497c-a8f2-a86d4d723bde admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.306306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1066/2114] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:17 2022] PUT /identity/v3/projects/232a88acedbc4c3981f4a68cd5572c9e/users/8415aa9435a543bbb93756ba5f706152/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:17.311260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899605-6a0c-44f7-b780-79fd94fa1342 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.311595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899605-6a0c-44f7-b780-79fd94fa1342 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.312006 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899605-6a0c-44f7-b780-79fd94fa1342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.336254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-df899605-6a0c-44f7-b780-79fd94fa1342 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:17.337462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-df899605-6a0c-44f7-b780-79fd94fa1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:17.340098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1049/2115] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:17 2022] PUT /identity/v3/projects/46d80edbd53247d584b24c763793e376/users/642bee02791a4f50a25aceb077eb2232/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:17.341050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb7bb8-7bd3-497c-a8f2-a86d4d723bde admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:17.417133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb7bb8-7bd3-497c-a8f2-a86d4d723bde admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:17.419464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1067/2116] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:17.424389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d681e-ca8e-4ee8-bec2-2f94f5cbd1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:17.425171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d681e-ca8e-4ee8-bec2-2f94f5cbd1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.425459 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d681e-ca8e-4ee8-bec2-2f94f5cbd1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.425743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d681e-ca8e-4ee8-bec2-2f94f5cbd1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.426451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d681e-ca8e-4ee8-bec2-2f94f5cbd1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:17.428046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899605-6a0c-44f7-b780-79fd94fa1342 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:17.429748 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-df899605-6a0c-44f7-b780-79fd94fa1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:17.452968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3d681e-ca8e-4ee8-bec2-2f94f5cbd1b9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.471725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1050/2117] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:17.473076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d681e-ca8e-4ee8-bec2-2f94f5cbd1b9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:17.500319 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d681e-ca8e-4ee8-bec2-2f94f5cbd1b9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:17.508964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef078223-6dcb-4899-9c91-84b4759dbf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:17.509799 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef078223-6dcb-4899-9c91-84b4759dbf13 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.510086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef078223-6dcb-4899-9c91-84b4759dbf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.510364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef078223-6dcb-4899-9c91-84b4759dbf13 admin admin] PATH_INFO: `/v3/projects/46d80edbd53247d584b24c763793e376/users/642bee02791a4f50a25aceb077eb2232/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.513809 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef078223-6dcb-4899-9c91-84b4759dbf13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d80edbd53247d584b24c763793e376, user_id=642bee02791a4f50a25aceb077eb2232, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:17.523273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899605-6a0c-44f7-b780-79fd94fa1342 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:17.527068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae8587-a9df-4e60-abda-5f8ee17f2439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:17.528440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae8587-a9df-4e60-abda-5f8ee17f2439 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.528744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae8587-a9df-4e60-abda-5f8ee17f2439 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.529030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae8587-a9df-4e60-abda-5f8ee17f2439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.541796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae8587-a9df-4e60-abda-5f8ee17f2439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:17.545353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef078223-6dcb-4899-9c91-84b4759dbf13 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.575555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1051/2118] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:17 2022] PUT /identity/v3/projects/46d80edbd53247d584b24c763793e376/users/642bee02791a4f50a25aceb077eb2232/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:17.580476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef078223-6dcb-4899-9c91-84b4759dbf13 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:17.582668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae8587-a9df-4e60-abda-5f8ee17f2439 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.609991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1068/2119] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:12:17.677485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef078223-6dcb-4899-9c91-84b4759dbf13 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:17.689105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4d1b1-f6de-424d-9a3f-d50eb9d3d6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:17.689105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4d1b1-f6de-424d-9a3f-d50eb9d3d6de admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.689105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4d1b1-f6de-424d-9a3f-d50eb9d3d6de admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.689105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4d1b1-f6de-424d-9a3f-d50eb9d3d6de admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.689648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4d1b1-f6de-424d-9a3f-d50eb9d3d6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:17.723772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4d1b1-f6de-424d-9a3f-d50eb9d3d6de admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.728405 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1052/2120] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:17.734579 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae8587-a9df-4e60-abda-5f8ee17f2439 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:17.745345 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae8587-a9df-4e60-abda-5f8ee17f2439 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:17.752133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859bda-d97f-4dd7-94bd-ebe7e2c8058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:17.753096 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859bda-d97f-4dd7-94bd-ebe7e2c8058f admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.753465 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859bda-d97f-4dd7-94bd-ebe7e2c8058f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.753852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859bda-d97f-4dd7-94bd-ebe7e2c8058f admin admin] PATH_INFO: `/v3/projects/46d80edbd53247d584b24c763793e376/users/642bee02791a4f50a25aceb077eb2232/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:17.755819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859bda-d97f-4dd7-94bd-ebe7e2c8058f admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d80edbd53247d584b24c763793e376, user_id=642bee02791a4f50a25aceb077eb2232, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:17.786910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859bda-d97f-4dd7-94bd-ebe7e2c8058f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:17.929201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1069/2121] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:17 2022] PUT /identity/v3/projects/46d80edbd53247d584b24c763793e376/users/642bee02791a4f50a25aceb077eb2232/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:17.941305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9910677-a834-4208-84dd-6b5dd525e4c0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:17.941612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9910677-a834-4208-84dd-6b5dd525e4c0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:17.941895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9910677-a834-4208-84dd-6b5dd525e4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:18.109534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d9910677-a834-4208-84dd-6b5dd525e4c0 None None] MFA Rules not processed for user `642bee02791a4f50a25aceb077eb2232`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:18.111191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d9910677-a834-4208-84dd-6b5dd525e4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:18.194402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1053/2122] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3749 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:18.205227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859bda-d97f-4dd7-94bd-ebe7e2c8058f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:18.207065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-bb859bda-d97f-4dd7-94bd-ebe7e2c8058f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:18.280307 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859bda-d97f-4dd7-94bd-ebe7e2c8058f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:18.284735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55499622-7d39-4627-83fd-23c1bb0e5625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:18.285274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55499622-7d39-4627-83fd-23c1bb0e5625 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:18.285568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55499622-7d39-4627-83fd-23c1bb0e5625 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:18.285863 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55499622-7d39-4627-83fd-23c1bb0e5625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:18.287558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-55499622-7d39-4627-83fd-23c1bb0e5625 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:18.355143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55499622-7d39-4627-83fd-23c1bb0e5625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:18.383152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55499622-7d39-4627-83fd-23c1bb0e5625 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:18.392791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1070/2123] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:18 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:19.202843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5342e4-d37e-4741-9d27-4cf6718b8b4e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:19.204394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5342e4-d37e-4741-9d27-4cf6718b8b4e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:19.204893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5342e4-d37e-4741-9d27-4cf6718b8b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:19.253912 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-bb5342e4-d37e-4741-9d27-4cf6718b8b4e None None] MFA Rules not processed for user `8415aa9435a543bbb93756ba5f706152`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:19.255424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bb5342e4-d37e-4741-9d27-4cf6718b8b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:19.342233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1054/2124] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:19 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:19.352019 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55499622-7d39-4627-83fd-23c1bb0e5625 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:19.360881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55499622-7d39-4627-83fd-23c1bb0e5625 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:19.364484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8afc2-14de-42fb-bc0e-3b1a4581e962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:19.365065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8afc2-14de-42fb-bc0e-3b1a4581e962 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:19.365714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8afc2-14de-42fb-bc0e-3b1a4581e962 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:19.365714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8afc2-14de-42fb-bc0e-3b1a4581e962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:19.374686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8afc2-14de-42fb-bc0e-3b1a4581e962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:19.402816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8afc2-14de-42fb-bc0e-3b1a4581e962 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:19.412641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1071/2125] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:19 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:24.692044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5342e4-d37e-4741-9d27-4cf6718b8b4e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:24.701581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5342e4-d37e-4741-9d27-4cf6718b8b4e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:24.705224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f6efd-b20c-45d2-add1-43ba83cb9077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:24.705805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f6efd-b20c-45d2-add1-43ba83cb9077 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:24.706096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f6efd-b20c-45d2-add1-43ba83cb9077 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:24.706381 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f6efd-b20c-45d2-add1-43ba83cb9077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:24.773725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f6efd-b20c-45d2-add1-43ba83cb9077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:24.801153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f6efd-b20c-45d2-add1-43ba83cb9077 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:24.810840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1055/2126] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:24 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:25.654141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3e342-7174-4b7b-bb1b-7c811527de65 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:25.654656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3e342-7174-4b7b-bb1b-7c811527de65 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:25.654747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3e342-7174-4b7b-bb1b-7c811527de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:25.679733 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-60f3e342-7174-4b7b-bb1b-7c811527de65 None None] MFA Rules not processed for user `8415aa9435a543bbb93756ba5f706152`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:25.680888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-60f3e342-7174-4b7b-bb1b-7c811527de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:25.688136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1072/2127] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:26.664229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f6efd-b20c-45d2-add1-43ba83cb9077 service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:26.665760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-cc4f6efd-b20c-45d2-add1-43ba83cb9077 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:26.758475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f6efd-b20c-45d2-add1-43ba83cb9077 service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:26.761484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:26.762293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:26.762576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:26.762853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] PATH_INFO: `/v3/users/b7747d57c0434ce8a084d42c9aaef960` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:26.763970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7747d57c0434ce8a084d42c9aaef960)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:26.796965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:26.964593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3e342-7174-4b7b-bb1b-7c811527de65 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:26.966951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-60f3e342-7174-4b7b-bb1b-7c811527de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:26.987629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3e342-7174-4b7b-bb1b-7c811527de65 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:26.992798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e217ee7-fd8e-4734-8d44-22a60216c2f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:26.994340 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e217ee7-fd8e-4734-8d44-22a60216c2f6 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:26.994880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e217ee7-fd8e-4734-8d44-22a60216c2f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:26.995382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e217ee7-fd8e-4734-8d44-22a60216c2f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:27.008905 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e217ee7-fd8e-4734-8d44-22a60216c2f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:27.044263 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e217ee7-fd8e-4734-8d44-22a60216c2f6 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:27.084298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1073/2128] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:26 2022] GET /identity/v3/auth/tokens => generated 3749 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:12:27.107914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7747d57c0434ce8a084d42c9aaef960'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:27.134647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7747d57c0434ce8a084d42c9aaef960'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:27.135826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7747d57c0434ce8a084d42c9aaef960'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:27.157761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7747d57c0434ce8a084d42c9aaef960'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:27.277567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7747d57c0434ce8a084d42c9aaef960'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:27.284567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1056/2129] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:26 2022] DELETE /identity/v3/users/b7747d57c0434ce8a084d42c9aaef960 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:27.288989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af691f-8972-495a-9bc5-cab6908bc155 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:27.289205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af691f-8972-495a-9bc5-cab6908bc155 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:27.289535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af691f-8972-495a-9bc5-cab6908bc155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:27.319854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-90af691f-8972-495a-9bc5-cab6908bc155 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:27.321052 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-90af691f-8972-495a-9bc5-cab6908bc155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:27.416595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1074/2130] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:27.427615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:27.428552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:27.536480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f74a26-83f5-4584-822a-0ccbf877f484 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:27.540271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfa35-3e77-4882-a6e6-571e509d2a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:27.540870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfa35-3e77-4882-a6e6-571e509d2a38 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:27.541158 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfa35-3e77-4882-a6e6-571e509d2a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:27.541445 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bfa35-3e77-4882-a6e6-571e509d2a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:27.554697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bfa35-3e77-4882-a6e6-571e509d2a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:27.590023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bfa35-3e77-4882-a6e6-571e509d2a38 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:27.603645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1057/2131] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:27 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:28.317766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af691f-8972-495a-9bc5-cab6908bc155 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:28.319251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-90af691f-8972-495a-9bc5-cab6908bc155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:28.331359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af691f-8972-495a-9bc5-cab6908bc155 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:28.335924 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:28.336789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:28.336995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:28.337288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] PATH_INFO: `/v3/projects/e7095f983c5045239ef0e03031ae3d99` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:28.338389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7095f983c5045239ef0e03031ae3d99)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:28.364801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:28.517649 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7095f983c5045239ef0e03031ae3d99', 'request_id': 'req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:28.626692 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7095f983c5045239ef0e03031ae3d99', 'request_id': 'req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:28.638664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7095f983c5045239ef0e03031ae3d99', 'request_id': 'req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:28.650325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] The token cache is being invalidate because project e7095f983c5045239ef0e03031ae3d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:28.650607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:28.651235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:28.652962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1075/2132] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:28 2022] DELETE /identity/v3/projects/e7095f983c5045239ef0e03031ae3d99 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:28.657331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfa35-3e77-4882-a6e6-571e509d2a38 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:28.667558 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bfa35-3e77-4882-a6e6-571e509d2a38 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:28.747238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:28.748275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:28.748556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:28.748836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] PATH_INFO: `/v3/users/b30fbc0706f642928a22a452864659f6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:28.749937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b30fbc0706f642928a22a452864659f6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:28.777417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:29.068801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b30fbc0706f642928a22a452864659f6'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:29.095341 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b30fbc0706f642928a22a452864659f6'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:29.096425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b30fbc0706f642928a22a452864659f6'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:29.105489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b30fbc0706f642928a22a452864659f6'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:29.225381 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b30fbc0706f642928a22a452864659f6'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:29.232750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1058/2133] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:28 2022] DELETE /identity/v3/users/b30fbc0706f642928a22a452864659f6 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:29.915027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:29.916172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:29.941300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e3e0c-c7d6-4e33-80f6-965426b3cb11 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:30.013383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:30.014410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:30.014907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:30.015384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] PATH_INFO: `/v3/projects/364cfd5b57584c6a8d466398c4a7927f` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:30.017432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=364cfd5b57584c6a8d466398c4a7927f)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:30.049175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:30.214507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364cfd5b57584c6a8d466398c4a7927f', 'request_id': 'req-c2882f03-234c-40a7-bde3-881b44a807cd'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:30.392872 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364cfd5b57584c6a8d466398c4a7927f', 'request_id': 'req-c2882f03-234c-40a7-bde3-881b44a807cd'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:30.408329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364cfd5b57584c6a8d466398c4a7927f', 'request_id': 'req-c2882f03-234c-40a7-bde3-881b44a807cd'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:30.420233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] The token cache is being invalidate because project 364cfd5b57584c6a8d466398c4a7927f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:30.421018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:30.421634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:30.423531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1076/2134] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:29 2022] DELETE /identity/v3/projects/364cfd5b57584c6a8d466398c4a7927f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:30.430637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:30.432034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:30.445293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c47a64-52cd-4cbd-92ce-8eb8c8145f21 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:30.550390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:30.551499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:30.551875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:30.552348 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] PATH_INFO: `/v3/users/c9cccac9e22c4498a292ad7b84ffa663` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:30.554877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9cccac9e22c4498a292ad7b84ffa663)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:30.586209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:30.888703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9cccac9e22c4498a292ad7b84ffa663'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:30.901895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9cccac9e22c4498a292ad7b84ffa663'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:30.903714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9cccac9e22c4498a292ad7b84ffa663'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:30.913092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9cccac9e22c4498a292ad7b84ffa663'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:31.008543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9cccac9e22c4498a292ad7b84ffa663'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:31.015181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1059/2135] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:30 2022] DELETE /identity/v3/users/c9cccac9e22c4498a292ad7b84ffa663 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:31.843038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:31.851727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:31.889257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2882f03-234c-40a7-bde3-881b44a807cd admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:31.971168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:31.972117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:31.972474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:31.972832 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] PATH_INFO: `/v3/projects/37c373c3a89e4425b2e8a2466dd65876` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:31.974069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c373c3a89e4425b2e8a2466dd65876)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:32.000944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:32.191255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c373c3a89e4425b2e8a2466dd65876', 'request_id': 'req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.221444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:32.224836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:32.240198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa80052-d9d2-4238-8f7c-fef08e1a99df admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:32.274569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c373c3a89e4425b2e8a2466dd65876', 'request_id': 'req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.295755 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c373c3a89e4425b2e8a2466dd65876', 'request_id': 'req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.340873 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] The token cache is being invalidate because project 37c373c3a89e4425b2e8a2466dd65876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:32.341165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.341823 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7d6ef5cc-2191-4651-b74d-7fb63287d0d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.343478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1077/2136] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:31 2022] DELETE /identity/v3/projects/37c373c3a89e4425b2e8a2466dd65876 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:32.351159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0f185-a010-493e-ba30-7007eec52dd8 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:32.351493 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0f185-a010-493e-ba30-7007eec52dd8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:32.351959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f0f185-a010-493e-ba30-7007eec52dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:32.369435 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:32.370398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:32.372103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:32.372103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] PATH_INFO: `/v3/users/3d7234bba23e406db45a253267b5502f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:32.372441 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7234bba23e406db45a253267b5502f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:32.385537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c7f0f185-a010-493e-ba30-7007eec52dd8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:32.387541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c7f0f185-a010-493e-ba30-7007eec52dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:32.398169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1078/2137] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:32.407707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41a29-e28c-4bb9-bed3-c02e05ac5854 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:32.408071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41a29-e28c-4bb9-bed3-c02e05ac5854 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:32.410842 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df41a29-e28c-4bb9-bed3-c02e05ac5854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:32.415437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:32.447405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1df41a29-e28c-4bb9-bed3-c02e05ac5854 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:32.449200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1df41a29-e28c-4bb9-bed3-c02e05ac5854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:32.460741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1079/2138] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:32.465306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df41a29-e28c-4bb9-bed3-c02e05ac5854 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:32.474853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df41a29-e28c-4bb9-bed3-c02e05ac5854 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:32.479597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad0785-e91d-4c03-8044-d8f471adb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:32.480264 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad0785-e91d-4c03-8044-d8f471adb355 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:32.480618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad0785-e91d-4c03-8044-d8f471adb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:32.481045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad0785-e91d-4c03-8044-d8f471adb355 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:32.481779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad0785-e91d-4c03-8044-d8f471adb355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:12:32.482101 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad0785-e91d-4c03-8044-d8f471adb355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:32.508671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad0785-e91d-4c03-8044-d8f471adb355 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:32.523764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1080/2139] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:12:32.529978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad0785-e91d-4c03-8044-d8f471adb355 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:32.542048 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad0785-e91d-4c03-8044-d8f471adb355 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:32.546811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b92b4-3f02-4317-b2f0-f432a88a05fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:32.548105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b92b4-3f02-4317-b2f0-f432a88a05fc admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:32.548396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b92b4-3f02-4317-b2f0-f432a88a05fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:32.548680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b92b4-3f02-4317-b2f0-f432a88a05fc admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:32.549336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b92b4-3f02-4317-b2f0-f432a88a05fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:32.576319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b92b4-3f02-4317-b2f0-f432a88a05fc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:32.663665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7234bba23e406db45a253267b5502f'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.677552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7234bba23e406db45a253267b5502f'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.678339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7234bba23e406db45a253267b5502f'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.686340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7234bba23e406db45a253267b5502f'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.711237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1081/2140] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:32 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:32.711237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b92b4-3f02-4317-b2f0-f432a88a05fc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:32.789719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b92b4-3f02-4317-b2f0-f432a88a05fc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:32.793935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3155d-6074-465d-a5a9-b6d578548802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:32.794541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3155d-6074-465d-a5a9-b6d578548802 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:32.808618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3155d-6074-465d-a5a9-b6d578548802 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:32.808618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d3155d-6074-465d-a5a9-b6d578548802 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:32.809133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a966460b-5c59-4055-bc2f-87d1dd07b1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7234bba23e406db45a253267b5502f'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:32.809223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3155d-6074-465d-a5a9-b6d578548802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:32.809296 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1060/2141] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:32 2022] DELETE /identity/v3/users/3d7234bba23e406db45a253267b5502f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:32.813826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec437-6b69-4646-bfcd-000df23d96e5 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:32.814549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec437-6b69-4646-bfcd-000df23d96e5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:32.815156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aec437-6b69-4646-bfcd-000df23d96e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:32.824612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d3155d-6074-465d-a5a9-b6d578548802 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:32.846695 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-e6aec437-6b69-4646-bfcd-000df23d96e5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:32.847905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e6aec437-6b69-4646-bfcd-000df23d96e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:32.919458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1061/2142] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:32 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:32.929749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aec437-6b69-4646-bfcd-000df23d96e5 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:32.931079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e6aec437-6b69-4646-bfcd-000df23d96e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:32.989606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1082/2143] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:32 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:32.990629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3155d-6074-465d-a5a9-b6d578548802 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:32.992267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-04d3155d-6074-465d-a5a9-b6d578548802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:32.995484 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aec437-6b69-4646-bfcd-000df23d96e5 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:32.999059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1a511-b67b-4875-9933-628e3ba5e30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:32.999676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1a511-b67b-4875-9933-628e3ba5e30b service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:32.999986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1a511-b67b-4875-9933-628e3ba5e30b service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:33.000388 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1a511-b67b-4875-9933-628e3ba5e30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:33.003629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d3155d-6074-465d-a5a9-b6d578548802 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:33.008796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945edc41-2f82-4f30-bb5e-595846b31e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:33.009389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945edc41-2f82-4f30-bb5e-595846b31e32 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:33.009499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1a511-b67b-4875-9933-628e3ba5e30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:33.009679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945edc41-2f82-4f30-bb5e-595846b31e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:33.009956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945edc41-2f82-4f30-bb5e-595846b31e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:33.010878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945edc41-2f82-4f30-bb5e-595846b31e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:33.036292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1a511-b67b-4875-9933-628e3ba5e30b service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:33.046448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1062/2144] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:32 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:12:33.050004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945edc41-2f82-4f30-bb5e-595846b31e32 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:33.064938 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1083/2145] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:12:33.066433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1a511-b67b-4875-9933-628e3ba5e30b service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:33.077044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1a511-b67b-4875-9933-628e3ba5e30b service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:33.082989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1eb6e-ca8c-4c31-bcd3-dacbaeb8da11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:33.084149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1eb6e-ca8c-4c31-bcd3-dacbaeb8da11 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:33.084613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1eb6e-ca8c-4c31-bcd3-dacbaeb8da11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:33.085045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1eb6e-ca8c-4c31-bcd3-dacbaeb8da11 admin admin] PATH_INFO: `/v3/projects/925666bc37a54c76b5b732a59cda94fa/users/cbe840e443b74b269ff403c12fd36711/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:33.107692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1eb6e-ca8c-4c31-bcd3-dacbaeb8da11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925666bc37a54c76b5b732a59cda94fa, user_id=cbe840e443b74b269ff403c12fd36711, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:33.140552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee1eb6e-ca8c-4c31-bcd3-dacbaeb8da11 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:33.260764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1063/2146] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:33 2022] PUT /identity/v3/projects/925666bc37a54c76b5b732a59cda94fa/users/cbe840e443b74b269ff403c12fd36711/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:33.272675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa99f04-7098-4f6c-b549-45e2a9a4d574 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:33.272971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa99f04-7098-4f6c-b549-45e2a9a4d574 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:33.273253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa99f04-7098-4f6c-b549-45e2a9a4d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:33.347546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-efa99f04-7098-4f6c-b549-45e2a9a4d574 None None] MFA Rules not processed for user `cbe840e443b74b269ff403c12fd36711`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:33.348808 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-efa99f04-7098-4f6c-b549-45e2a9a4d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:33.428883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1084/2147] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:33 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:33.433488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1eb6e-ca8c-4c31-bcd3-dacbaeb8da11 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:33.510509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1eb6e-ca8c-4c31-bcd3-dacbaeb8da11 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:33.515145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f9cb6-f209-4e7b-94c3-f0843ebf636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:33.515848 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f9cb6-f209-4e7b-94c3-f0843ebf636c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:33.516261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f9cb6-f209-4e7b-94c3-f0843ebf636c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:33.516552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f9cb6-f209-4e7b-94c3-f0843ebf636c admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:33.517206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f9cb6-f209-4e7b-94c3-f0843ebf636c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:33.544295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f9cb6-f209-4e7b-94c3-f0843ebf636c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:33.661983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1064/2148] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:33 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:33.663675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa99f04-7098-4f6c-b549-45e2a9a4d574 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:33.678166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa99f04-7098-4f6c-b549-45e2a9a4d574 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:33.766441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01fe46-1fec-4ee9-b8af-a6b5d1df941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:33.767269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01fe46-1fec-4ee9-b8af-a6b5d1df941d admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:33.767672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01fe46-1fec-4ee9-b8af-a6b5d1df941d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:33.768024 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01fe46-1fec-4ee9-b8af-a6b5d1df941d admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:33.768740 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01fe46-1fec-4ee9-b8af-a6b5d1df941d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:33.797868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01fe46-1fec-4ee9-b8af-a6b5d1df941d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:33.901385 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f9cb6-f209-4e7b-94c3-f0843ebf636c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:33.903508 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c62f9cb6-f209-4e7b-94c3-f0843ebf636c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:33.918036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f9cb6-f209-4e7b-94c3-f0843ebf636c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:33.924884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:33.925857 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:33.926242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:33.926585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] PATH_INFO: `/v3/projects/b88e370b93ef4ee3acbeb5ee4a88abb5` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:33.927872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88e370b93ef4ee3acbeb5ee4a88abb5)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:33.951161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1085/2149] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:33 2022] POST /identity/v3/users => generated 300 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:33.955242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01fe46-1fec-4ee9-b8af-a6b5d1df941d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:33.957236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:33.965632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01fe46-1fec-4ee9-b8af-a6b5d1df941d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:33.970903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ae940-7d0c-4028-bebf-80998e359764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:33.971558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ae940-7d0c-4028-bebf-80998e359764 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:33.971849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ae940-7d0c-4028-bebf-80998e359764 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:33.972135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ae940-7d0c-4028-bebf-80998e359764 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:33.972972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ae940-7d0c-4028-bebf-80998e359764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:34.005032 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ae940-7d0c-4028-bebf-80998e359764 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:34.016043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1086/2150] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:12:34.020206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ae940-7d0c-4028-bebf-80998e359764 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:34.030114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ae940-7d0c-4028-bebf-80998e359764 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:34.035146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1ba2-bc23-4c28-84c0-8d9d3d88b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:34.036045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1ba2-bc23-4c28-84c0-8d9d3d88b80c admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.036329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1ba2-bc23-4c28-84c0-8d9d3d88b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.036609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e1ba2-bc23-4c28-84c0-8d9d3d88b80c admin admin] PATH_INFO: `/v3/projects/e85ec2c9bd4f432a80b3a5c5c410ca04/users/568eb6b90dec4fda8e09d4c94edb5b10/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.059373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e1ba2-bc23-4c28-84c0-8d9d3d88b80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85ec2c9bd4f432a80b3a5c5c410ca04, user_id=568eb6b90dec4fda8e09d4c94edb5b10, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:34.085219 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88e370b93ef4ee3acbeb5ee4a88abb5', 'request_id': 'req-b1a73220-9644-4555-b2c4-27170861fba1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:34.101450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e1ba2-bc23-4c28-84c0-8d9d3d88b80c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:34.151164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88e370b93ef4ee3acbeb5ee4a88abb5', 'request_id': 'req-b1a73220-9644-4555-b2c4-27170861fba1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:34.163688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88e370b93ef4ee3acbeb5ee4a88abb5', 'request_id': 'req-b1a73220-9644-4555-b2c4-27170861fba1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:34.174379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] The token cache is being invalidate because project b88e370b93ef4ee3acbeb5ee4a88abb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:34.174667 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:34.175488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b1a73220-9644-4555-b2c4-27170861fba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:34.177187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1065/2151] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:33 2022] DELETE /identity/v3/projects/b88e370b93ef4ee3acbeb5ee4a88abb5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:34.180855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1087/2152] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:34 2022] PUT /identity/v3/projects/e85ec2c9bd4f432a80b3a5c5c410ca04/users/568eb6b90dec4fda8e09d4c94edb5b10/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:34.183039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c5438-c361-4cb1-b6c5-8db36fd73757 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.183394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c5438-c361-4cb1-b6c5-8db36fd73757 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.183713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c5438-c361-4cb1-b6c5-8db36fd73757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.185011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1ba2-bc23-4c28-84c0-8d9d3d88b80c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:34.189511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c59e1ba2-bc23-4c28-84c0-8d9d3d88b80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:34.210211 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-6b6c5438-c361-4cb1-b6c5-8db36fd73757 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:34.211500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6b6c5438-c361-4cb1-b6c5-8db36fd73757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:34.262019 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e1ba2-bc23-4c28-84c0-8d9d3d88b80c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:34.266963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77284851-7a82-4f7f-90c4-ccafe03e0d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:34.267897 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77284851-7a82-4f7f-90c4-ccafe03e0d11 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.268334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77284851-7a82-4f7f-90c4-ccafe03e0d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.268812 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77284851-7a82-4f7f-90c4-ccafe03e0d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.269665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77284851-7a82-4f7f-90c4-ccafe03e0d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:34.286344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1066/2153] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:34.293776 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa93d83-6157-4039-ba31-92786842194f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.294080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa93d83-6157-4039-ba31-92786842194f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.294391 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa93d83-6157-4039-ba31-92786842194f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.296391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77284851-7a82-4f7f-90c4-ccafe03e0d11 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:34.308357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1088/2154] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:12:34.312014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77284851-7a82-4f7f-90c4-ccafe03e0d11 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:34.322070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77284851-7a82-4f7f-90c4-ccafe03e0d11 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:34.322675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-3aa93d83-6157-4039-ba31-92786842194f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:34.323872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-3aa93d83-6157-4039-ba31-92786842194f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:34.326474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c62d4-ae17-4b8c-9f7d-44399fcd3f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:34.327282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c62d4-ae17-4b8c-9f7d-44399fcd3f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.327602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c62d4-ae17-4b8c-9f7d-44399fcd3f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.327883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c62d4-ae17-4b8c-9f7d-44399fcd3f46 admin admin] PATH_INFO: `/v3/projects/e85ec2c9bd4f432a80b3a5c5c410ca04/users/568eb6b90dec4fda8e09d4c94edb5b10/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.330421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c62d4-ae17-4b8c-9f7d-44399fcd3f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85ec2c9bd4f432a80b3a5c5c410ca04, user_id=568eb6b90dec4fda8e09d4c94edb5b10, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:34.332279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1067/2155] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:34.336168 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa93d83-6157-4039-ba31-92786842194f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:34.352559 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa93d83-6157-4039-ba31-92786842194f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:34.357401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb813-87f5-4df5-b606-840332a91663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:34.358228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb813-87f5-4df5-b606-840332a91663 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.358665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb813-87f5-4df5-b606-840332a91663 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.359099 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3eb813-87f5-4df5-b606-840332a91663 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.360031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eb813-87f5-4df5-b606-840332a91663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:12:34.360480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eb813-87f5-4df5-b606-840332a91663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:34.387166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3eb813-87f5-4df5-b606-840332a91663 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:34.399697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c62d4-ae17-4b8c-9f7d-44399fcd3f46 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:34.405866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1068/2156] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:12:34.411192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb813-87f5-4df5-b606-840332a91663 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:34.426046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1089/2157] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:34 2022] PUT /identity/v3/projects/e85ec2c9bd4f432a80b3a5c5c410ca04/users/568eb6b90dec4fda8e09d4c94edb5b10/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:34.431099 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3eb813-87f5-4df5-b606-840332a91663 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:34.432654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c62d4-ae17-4b8c-9f7d-44399fcd3f46 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:34.528249 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c62d4-ae17-4b8c-9f7d-44399fcd3f46 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:34.533515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928052d-2bca-409b-9375-79046da74802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:34.534224 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928052d-2bca-409b-9375-79046da74802 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.534757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928052d-2bca-409b-9375-79046da74802 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.535139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928052d-2bca-409b-9375-79046da74802 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.536013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928052d-2bca-409b-9375-79046da74802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:34.540389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4131922-5cc0-4b6b-8a5f-8d93d86fe852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:34.541262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4131922-5cc0-4b6b-8a5f-8d93d86fe852 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.541699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4131922-5cc0-4b6b-8a5f-8d93d86fe852 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.542132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4131922-5cc0-4b6b-8a5f-8d93d86fe852 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.542925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4131922-5cc0-4b6b-8a5f-8d93d86fe852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:34.572952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928052d-2bca-409b-9375-79046da74802 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:34.595126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1090/2158] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:34.595826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4131922-5cc0-4b6b-8a5f-8d93d86fe852 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:34.596608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928052d-2bca-409b-9375-79046da74802 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:34.598250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7928052d-2bca-409b-9375-79046da74802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:34.612652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928052d-2bca-409b-9375-79046da74802 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:34.617426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:34.618230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.618521 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.618810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] PATH_INFO: `/v3/users/e33c16ce9b7c4f3ca249db2760fa4e12` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.620018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33c16ce9b7c4f3ca249db2760fa4e12)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:34.648551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:34.788986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1069/2159] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:34 2022] POST /identity/v3/projects => generated 389 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:34.789800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4131922-5cc0-4b6b-8a5f-8d93d86fe852 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:34.879759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4131922-5cc0-4b6b-8a5f-8d93d86fe852 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:34.890386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668526a5-44f2-4231-aa44-6fa4526e6bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:34.890386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668526a5-44f2-4231-aa44-6fa4526e6bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:34.890386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668526a5-44f2-4231-aa44-6fa4526e6bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:34.890386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668526a5-44f2-4231-aa44-6fa4526e6bdf admin admin] PATH_INFO: `/v3/projects/e85ec2c9bd4f432a80b3a5c5c410ca04/users/568eb6b90dec4fda8e09d4c94edb5b10/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:34.890726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668526a5-44f2-4231-aa44-6fa4526e6bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85ec2c9bd4f432a80b3a5c5c410ca04, user_id=568eb6b90dec4fda8e09d4c94edb5b10, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:34.917927 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668526a5-44f2-4231-aa44-6fa4526e6bdf admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:35.016620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33c16ce9b7c4f3ca249db2760fa4e12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:35.017271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33c16ce9b7c4f3ca249db2760fa4e12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:35.025037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33c16ce9b7c4f3ca249db2760fa4e12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:35.037076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33c16ce9b7c4f3ca249db2760fa4e12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:35.043491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1070/2160] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:34 2022] PUT /identity/v3/projects/e85ec2c9bd4f432a80b3a5c5c410ca04/users/568eb6b90dec4fda8e09d4c94edb5b10/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:35.044292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668526a5-44f2-4231-aa44-6fa4526e6bdf admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:35.115005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668526a5-44f2-4231-aa44-6fa4526e6bdf admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:35.119517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e25a-92fe-44ed-9e12-0b23d7ab1d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:35.120129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e25a-92fe-44ed-9e12-0b23d7ab1d25 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:35.120427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e25a-92fe-44ed-9e12-0b23d7ab1d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:35.120704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335e25a-92fe-44ed-9e12-0b23d7ab1d25 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:35.121425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e25a-92fe-44ed-9e12-0b23d7ab1d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:35.128348 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2d660a2e-e4c6-4e5c-a315-e9dea4d1e971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33c16ce9b7c4f3ca249db2760fa4e12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:35.135606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1091/2161] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:34 2022] DELETE /identity/v3/users/e33c16ce9b7c4f3ca249db2760fa4e12 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:35.137129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6a54c-3e06-4741-a45d-9f6e7307a21e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:35.137508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6a54c-3e06-4741-a45d-9f6e7307a21e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:35.137862 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6a54c-3e06-4741-a45d-9f6e7307a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:35.148433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335e25a-92fe-44ed-9e12-0b23d7ab1d25 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:35.175817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f9a6a54c-3e06-4741-a45d-9f6e7307a21e None None] MFA Rules not processed for user `568eb6b90dec4fda8e09d4c94edb5b10`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:35.178449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f9a6a54c-3e06-4741-a45d-9f6e7307a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:35.260740 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1092/2162] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:35.265194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc8a16-fabb-4e26-8ea0-14554204caf8 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:35.265500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc8a16-fabb-4e26-8ea0-14554204caf8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:35.265936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc8a16-fabb-4e26-8ea0-14554204caf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:35.281931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1071/2163] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:35 2022] POST /identity/v3/users => generated 295 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:35.283978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e25a-92fe-44ed-9e12-0b23d7ab1d25 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:35.285327 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b335e25a-92fe-44ed-9e12-0b23d7ab1d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:35.298857 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-73dc8a16-fabb-4e26-8ea0-14554204caf8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:35.300740 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-73dc8a16-fabb-4e26-8ea0-14554204caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:35.389803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1093/2164] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:35.390779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc8a16-fabb-4e26-8ea0-14554204caf8 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:35.394415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335e25a-92fe-44ed-9e12-0b23d7ab1d25 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:35.395419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-73dc8a16-fabb-4e26-8ea0-14554204caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:35.410372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc8a16-fabb-4e26-8ea0-14554204caf8 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:35.415187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaaf07-8693-4a6d-88aa-230f5ac7ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:35.415822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaaf07-8693-4a6d-88aa-230f5ac7ef39 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:35.416104 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaaf07-8693-4a6d-88aa-230f5ac7ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:35.416382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaaf07-8693-4a6d-88aa-230f5ac7ef39 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:35.417068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaaf07-8693-4a6d-88aa-230f5ac7ef39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:35.443464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaaf07-8693-4a6d-88aa-230f5ac7ef39 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:35.454403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1094/2165] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:35.455376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaaf07-8693-4a6d-88aa-230f5ac7ef39 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:35.457165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-beeaaf07-8693-4a6d-88aa-230f5ac7ef39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:35.459090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9aa6d-1cda-4786-86a5-e3b3dba48c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:35.459775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9aa6d-1cda-4786-86a5-e3b3dba48c60 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:35.460063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9aa6d-1cda-4786-86a5-e3b3dba48c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:35.460339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9aa6d-1cda-4786-86a5-e3b3dba48c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:35.470176 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9aa6d-1cda-4786-86a5-e3b3dba48c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:35.496023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9aa6d-1cda-4786-86a5-e3b3dba48c60 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:35.506038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1072/2166] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:35.506699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9aa6d-1cda-4786-86a5-e3b3dba48c60 service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:35.516468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9aa6d-1cda-4786-86a5-e3b3dba48c60 service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:35.521240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59201ff6-6606-48cd-869e-c3fe3cf6bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:35.522173 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59201ff6-6606-48cd-869e-c3fe3cf6bad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:35.522526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59201ff6-6606-48cd-869e-c3fe3cf6bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:35.522879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59201ff6-6606-48cd-869e-c3fe3cf6bad1 admin admin] PATH_INFO: `/v3/projects/f0a8691798534f86b2c96daec26342f1/users/49a8e329451b4d56b78855cea6510e7b/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:35.523944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaaf07-8693-4a6d-88aa-230f5ac7ef39 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:35.528736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd03d5-1f7e-4a8c-9653-7b2e9437b928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:35.529395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd03d5-1f7e-4a8c-9653-7b2e9437b928 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:35.529756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd03d5-1f7e-4a8c-9653-7b2e9437b928 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:35.530112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd03d5-1f7e-4a8c-9653-7b2e9437b928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:35.542792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd03d5-1f7e-4a8c-9653-7b2e9437b928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:35.546533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59201ff6-6606-48cd-869e-c3fe3cf6bad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a8691798534f86b2c96daec26342f1, user_id=49a8e329451b4d56b78855cea6510e7b, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:35.566747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd03d5-1f7e-4a8c-9653-7b2e9437b928 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:35.573823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59201ff6-6606-48cd-869e-c3fe3cf6bad1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:35.576882 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1095/2167] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:35.671495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1073/2168] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:35 2022] PUT /identity/v3/projects/f0a8691798534f86b2c96daec26342f1/users/49a8e329451b4d56b78855cea6510e7b/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:35.673567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a0bde-dd48-484f-b656-0c926f4b5149 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:35.673847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a0bde-dd48-484f-b656-0c926f4b5149 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:35.674128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a0bde-dd48-484f-b656-0c926f4b5149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:35.716879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c77a0bde-dd48-484f-b656-0c926f4b5149 None None] MFA Rules not processed for user `49a8e329451b4d56b78855cea6510e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:35.718381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c77a0bde-dd48-484f-b656-0c926f4b5149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:35.794295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1096/2169] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3696 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:35.803738 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59201ff6-6606-48cd-869e-c3fe3cf6bad1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:35.869709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59201ff6-6606-48cd-869e-c3fe3cf6bad1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:35.873712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f09481-55ac-4b02-bbdd-2622a772eaea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:35.874480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f09481-55ac-4b02-bbdd-2622a772eaea service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:35.874799 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f09481-55ac-4b02-bbdd-2622a772eaea service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:35.875112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f09481-55ac-4b02-bbdd-2622a772eaea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:35.887432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f09481-55ac-4b02-bbdd-2622a772eaea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:35.915797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f09481-55ac-4b02-bbdd-2622a772eaea service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:35.925636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1074/2170] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3696 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:36.136971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a0bde-dd48-484f-b656-0c926f4b5149 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:36.141627 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c77a0bde-dd48-484f-b656-0c926f4b5149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:36.232619 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a0bde-dd48-484f-b656-0c926f4b5149 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:36.238432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:36.239873 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:36.240352 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:36.240740 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] PATH_INFO: `/v3/projects/5eb3e9233b3440c1a7481e0c73a04645` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:36.241956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb3e9233b3440c1a7481e0c73a04645)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:36.271391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:36.431873 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb3e9233b3440c1a7481e0c73a04645', 'request_id': 'req-81b0df05-e07f-40e7-8b8f-91ec36e5365b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:36.526205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb3e9233b3440c1a7481e0c73a04645', 'request_id': 'req-81b0df05-e07f-40e7-8b8f-91ec36e5365b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:36.538779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb3e9233b3440c1a7481e0c73a04645', 'request_id': 'req-81b0df05-e07f-40e7-8b8f-91ec36e5365b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:36.550778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] The token cache is being invalidate because project 5eb3e9233b3440c1a7481e0c73a04645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:36.551153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:36.551954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:36.556781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1097/2171] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:36 2022] DELETE /identity/v3/projects/5eb3e9233b3440c1a7481e0c73a04645 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:36.558007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f09481-55ac-4b02-bbdd-2622a772eaea service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:36.571133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f09481-55ac-4b02-bbdd-2622a772eaea service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:36.648092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:36.648993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:36.649298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:36.649572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] PATH_INFO: `/v3/users/7ca59b9efcb845188c94e090ad720410` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:36.650676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca59b9efcb845188c94e090ad720410)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:36.680056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:37.015100 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca59b9efcb845188c94e090ad720410'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:37.029241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca59b9efcb845188c94e090ad720410'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:37.030167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca59b9efcb845188c94e090ad720410'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:37.039892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca59b9efcb845188c94e090ad720410'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:37.141563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca59b9efcb845188c94e090ad720410'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:37.148497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1075/2172] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:36 2022] DELETE /identity/v3/users/7ca59b9efcb845188c94e090ad720410 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:37.838741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:37.840430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:37.854091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0df05-e07f-40e7-8b8f-91ec36e5365b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:37.924709 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:37.925513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:37.925851 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:37.926075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] PATH_INFO: `/v3/projects/1f5f8066e3924631917a64fca1cb9d16` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:37.927202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5f8066e3924631917a64fca1cb9d16)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:37.945915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:37.953965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:37.954721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:37.966970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea83da-8d73-47ac-8461-d0c1af85474b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:37.974090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:37.974923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:37.975214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:37.975572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] PATH_INFO: `/v3/users/cbe840e443b74b269ff403c12fd36711` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:37.976914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe840e443b74b269ff403c12fd36711)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:38.006536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:38.100386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5f8066e3924631917a64fca1cb9d16', 'request_id': 'req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.185095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5f8066e3924631917a64fca1cb9d16', 'request_id': 'req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.202231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5f8066e3924631917a64fca1cb9d16', 'request_id': 'req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.208599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] The token cache is being invalidate because project 1f5f8066e3924631917a64fca1cb9d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:38.208885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.209484 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.210909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1098/2173] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:37 2022] DELETE /identity/v3/projects/1f5f8066e3924631917a64fca1cb9d16 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:38.214774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:38.216072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:38.240265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe840e443b74b269ff403c12fd36711'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.254042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe840e443b74b269ff403c12fd36711'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.255164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe840e443b74b269ff403c12fd36711'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.263155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe840e443b74b269ff403c12fd36711'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.286287 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7759c3-7d3b-4eea-83b2-76c2c57b178a admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:38.290639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:38.291459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:38.291747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:38.292026 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] PATH_INFO: `/v3/users/642bee02791a4f50a25aceb077eb2232` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:38.293159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=642bee02791a4f50a25aceb077eb2232)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:38.322241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-5df91037-dc87-485e-86c6-f5d6286cd47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe840e443b74b269ff403c12fd36711'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.326287 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:38.328662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1076/2174] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:37 2022] DELETE /identity/v3/users/cbe840e443b74b269ff403c12fd36711 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:38.334613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15356483-e8fc-48d6-bf0a-38c721c28bb4 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:38.335031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15356483-e8fc-48d6-bf0a-38c721c28bb4 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:38.335419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15356483-e8fc-48d6-bf0a-38c721c28bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:38.357746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-15356483-e8fc-48d6-bf0a-38c721c28bb4 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:38.358888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-15356483-e8fc-48d6-bf0a-38c721c28bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:38.426402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1077/2175] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:38.436315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15356483-e8fc-48d6-bf0a-38c721c28bb4 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:38.437774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-15356483-e8fc-48d6-bf0a-38c721c28bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:38.507327 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15356483-e8fc-48d6-bf0a-38c721c28bb4 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:38.512142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9189c0-de12-4415-a387-818579825051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:38.512869 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9189c0-de12-4415-a387-818579825051 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:38.513214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9189c0-de12-4415-a387-818579825051 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:38.513500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9189c0-de12-4415-a387-818579825051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:38.524724 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9189c0-de12-4415-a387-818579825051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:38.549953 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642bee02791a4f50a25aceb077eb2232'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.550894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642bee02791a4f50a25aceb077eb2232'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.552658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9189c0-de12-4415-a387-818579825051 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:38.559795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642bee02791a4f50a25aceb077eb2232'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.564797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1078/2176] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:38.574113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642bee02791a4f50a25aceb077eb2232'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.697172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642bee02791a4f50a25aceb077eb2232'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:38.711042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1099/2177] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:38 2022] DELETE /identity/v3/users/642bee02791a4f50a25aceb077eb2232 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:39.307861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9189c0-de12-4415-a387-818579825051 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:39.309356 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-cc9189c0-de12-4415-a387-818579825051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:39.323088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9189c0-de12-4415-a387-818579825051 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:39.393625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:39.394414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:39.394726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:39.394972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] PATH_INFO: `/v3/projects/925666bc37a54c76b5b732a59cda94fa` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:39.396101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925666bc37a54c76b5b732a59cda94fa)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:39.421994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:39.491433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:39.493344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:39.507868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cff744-d074-4dfc-954e-d28690b05fa9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:39.514000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:39.514923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:39.515259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:39.515742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] PATH_INFO: `/v3/projects/46d80edbd53247d584b24c763793e376` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:39.518452 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d80edbd53247d584b24c763793e376)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:39.544487 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925666bc37a54c76b5b732a59cda94fa', 'request_id': 'req-ac3247a3-347c-4066-9e42-116d93f33680'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.545926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:39.642724 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925666bc37a54c76b5b732a59cda94fa', 'request_id': 'req-ac3247a3-347c-4066-9e42-116d93f33680'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.657454 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925666bc37a54c76b5b732a59cda94fa', 'request_id': 'req-ac3247a3-347c-4066-9e42-116d93f33680'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.668846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] The token cache is being invalidate because project 925666bc37a54c76b5b732a59cda94fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:39.669272 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.670032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.672533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1079/2178] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:39 2022] DELETE /identity/v3/projects/925666bc37a54c76b5b732a59cda94fa => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:39.676630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:39.678086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:39.707556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d80edbd53247d584b24c763793e376', 'request_id': 'req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.758099 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3247a3-347c-4066-9e42-116d93f33680 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:39.800434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d80edbd53247d584b24c763793e376', 'request_id': 'req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.812250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d80edbd53247d584b24c763793e376', 'request_id': 'req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.823329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:39.824464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:39.824695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] The token cache is being invalidate because project 46d80edbd53247d584b24c763793e376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:39.824796 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:39.824988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.825138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] PATH_INFO: `/v3/users/568eb6b90dec4fda8e09d4c94edb5b10` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:39.825843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eb2dfa11-5e37-45f8-b90c-149ddcbe5ad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:39.826155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] RBAC: Authorizing `identity:delete_user(user_id=568eb6b90dec4fda8e09d4c94edb5b10)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:39.827653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1100/2179] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:39 2022] DELETE /identity/v3/projects/46d80edbd53247d584b24c763793e376 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:39.835943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862834-8a3b-4c74-bea5-fd5da889649d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:39.835943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862834-8a3b-4c74-bea5-fd5da889649d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:39.835943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7862834-8a3b-4c74-bea5-fd5da889649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:39.859923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:39.862613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b7862834-8a3b-4c74-bea5-fd5da889649d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:39.863834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b7862834-8a3b-4c74-bea5-fd5da889649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:39.875980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1101/2180] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:39.884247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10df6c-6806-474e-8163-325176fbf13f None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:39.884683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10df6c-6806-474e-8163-325176fbf13f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:39.885067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10df6c-6806-474e-8163-325176fbf13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:39.910876 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-3d10df6c-6806-474e-8163-325176fbf13f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:39.912123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3d10df6c-6806-474e-8163-325176fbf13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:39.924514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1102/2181] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:39 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:39.925537 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10df6c-6806-474e-8163-325176fbf13f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:39.934785 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10df6c-6806-474e-8163-325176fbf13f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:39.939800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a96667-8857-44d1-a845-3c9f238f706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:39.940475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a96667-8857-44d1-a845-3c9f238f706c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:39.940767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a96667-8857-44d1-a845-3c9f238f706c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:39.941052 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a96667-8857-44d1-a845-3c9f238f706c admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:39.941800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a96667-8857-44d1-a845-3c9f238f706c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:12:39.942096 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a96667-8857-44d1-a845-3c9f238f706c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:39.977539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a96667-8857-44d1-a845-3c9f238f706c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:39.997326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1103/2182] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:12:39.998876 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a96667-8857-44d1-a845-3c9f238f706c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:40.011775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a96667-8857-44d1-a845-3c9f238f706c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:40.019949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb21751-2f75-4355-9b82-425d8fd5df61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:40.020678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb21751-2f75-4355-9b82-425d8fd5df61 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:40.021184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb21751-2f75-4355-9b82-425d8fd5df61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:40.021545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb21751-2f75-4355-9b82-425d8fd5df61 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:40.022248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb21751-2f75-4355-9b82-425d8fd5df61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:40.080982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb21751-2f75-4355-9b82-425d8fd5df61 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:40.129466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '568eb6b90dec4fda8e09d4c94edb5b10'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:40.162587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '568eb6b90dec4fda8e09d4c94edb5b10'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:40.164092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '568eb6b90dec4fda8e09d4c94edb5b10'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:40.173360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '568eb6b90dec4fda8e09d4c94edb5b10'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:40.210578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1104/2183] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:39 2022] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:40.214050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb21751-2f75-4355-9b82-425d8fd5df61 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:40.281712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb21751-2f75-4355-9b82-425d8fd5df61 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:40.286075 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786d4af-c06e-40e0-8231-7a0955ffebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:40.286684 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786d4af-c06e-40e0-8231-7a0955ffebfa admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:40.287007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786d4af-c06e-40e0-8231-7a0955ffebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:40.287247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786d4af-c06e-40e0-8231-7a0955ffebfa admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:40.287948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786d4af-c06e-40e0-8231-7a0955ffebfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:40.288074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '568eb6b90dec4fda8e09d4c94edb5b10'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:40.295139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1080/2184] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:39 2022] DELETE /identity/v3/users/568eb6b90dec4fda8e09d4c94edb5b10 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:40.314962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786d4af-c06e-40e0-8231-7a0955ffebfa admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:40.448756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1105/2185] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:40 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:12:40.452630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:40.454111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:40.543613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b147d6-83d9-462d-a079-b54ab3fd474b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:40.560625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca7427-67a5-441d-9b31-2de15e7eb4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:40.562145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca7427-67a5-441d-9b31-2de15e7eb4a1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:40.564049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca7427-67a5-441d-9b31-2de15e7eb4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:40.564545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca7427-67a5-441d-9b31-2de15e7eb4a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:40.566057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca7427-67a5-441d-9b31-2de15e7eb4a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:40.627354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca7427-67a5-441d-9b31-2de15e7eb4a1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:40.652853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1081/2186] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:40.655870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786d4af-c06e-40e0-8231-7a0955ffebfa admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:40.678292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786d4af-c06e-40e0-8231-7a0955ffebfa admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:40.686303 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc1ffb-9394-485a-bf05-26b902470897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:40.688439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1ffb-9394-485a-bf05-26b902470897 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:40.689076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1ffb-9394-485a-bf05-26b902470897 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:40.690271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1ffb-9394-485a-bf05-26b902470897 admin admin] PATH_INFO: `/v3/projects/1a5795016992488ea13ff3a5123b3cff/users/3e0b5da75f12486bb2e5c656161972c3/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:40.735200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc1ffb-9394-485a-bf05-26b902470897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5795016992488ea13ff3a5123b3cff, user_id=3e0b5da75f12486bb2e5c656161972c3, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:40.778920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbc1ffb-9394-485a-bf05-26b902470897 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:40.872176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1106/2187] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:40 2022] PUT /identity/v3/projects/1a5795016992488ea13ff3a5123b3cff/users/3e0b5da75f12486bb2e5c656161972c3/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:40.883963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16b00-32a1-41c5-a5a0-4bafe2b60d22 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:40.884336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16b00-32a1-41c5-a5a0-4bafe2b60d22 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:40.884962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb16b00-32a1-41c5-a5a0-4bafe2b60d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:40.927819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-7fb16b00-32a1-41c5-a5a0-4bafe2b60d22 None None] MFA Rules not processed for user `3e0b5da75f12486bb2e5c656161972c3`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:40.929099 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7fb16b00-32a1-41c5-a5a0-4bafe2b60d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:40.962040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc1ffb-9394-485a-bf05-26b902470897 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:40.963687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-9cbc1ffb-9394-485a-bf05-26b902470897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:41.015502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1082/2188] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:40 2022] POST /identity/v3/auth/tokens => generated 3674 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:41.027895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb16b00-32a1-41c5-a5a0-4bafe2b60d22 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:41.029320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7fb16b00-32a1-41c5-a5a0-4bafe2b60d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:41.038860 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc1ffb-9394-485a-bf05-26b902470897 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:41.048050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:41.048050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:41.048050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:41.048050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] PATH_INFO: `/v3/projects/e85ec2c9bd4f432a80b3a5c5c410ca04` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:41.048495 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85ec2c9bd4f432a80b3a5c5c410ca04)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:41.075987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:41.117678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb16b00-32a1-41c5-a5a0-4bafe2b60d22 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:41.122611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00af4d9-12e6-424e-829d-ed11a8490922 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aecbdda2f524fbca580d99b3001bed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:41.123293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00af4d9-12e6-424e-829d-ed11a8490922 service glance] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:41.123684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00af4d9-12e6-424e-829d-ed11a8490922 service glance] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:41.124031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00af4d9-12e6-424e-829d-ed11a8490922 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:41.135059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00af4d9-12e6-424e-829d-ed11a8490922 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:41.165950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00af4d9-12e6-424e-829d-ed11a8490922 service glance] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:41.176680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1083/2189] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:41 2022] GET /identity/v3/auth/tokens => generated 3674 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:12:41.262652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85ec2c9bd4f432a80b3a5c5c410ca04', 'request_id': 'req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:41.350756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85ec2c9bd4f432a80b3a5c5c410ca04', 'request_id': 'req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:41.364248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85ec2c9bd4f432a80b3a5c5c410ca04', 'request_id': 'req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:41.374917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] The token cache is being invalidate because project e85ec2c9bd4f432a80b3a5c5c410ca04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:41.375245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:41.375901 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-42a1a1ea-d265-43a1-8e6b-85ed89dfa4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:41.377405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1107/2190] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:40 2022] DELETE /identity/v3/projects/e85ec2c9bd4f432a80b3a5c5c410ca04 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:41.382834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810405-6905-428a-9fcf-cf976ae6273b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:41.383227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810405-6905-428a-9fcf-cf976ae6273b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:41.383645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810405-6905-428a-9fcf-cf976ae6273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:41.410265 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-87810405-6905-428a-9fcf-cf976ae6273b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:41.411452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-87810405-6905-428a-9fcf-cf976ae6273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:41.479179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1084/2191] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:41.490126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1290827-1f48-4ec8-b95a-27d64ef5095c None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:41.491855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1290827-1f48-4ec8-b95a-27d64ef5095c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:41.492422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1290827-1f48-4ec8-b95a-27d64ef5095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:41.522934 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f1290827-1f48-4ec8-b95a-27d64ef5095c None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:41.524149 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f1290827-1f48-4ec8-b95a-27d64ef5095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:41.533118 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1108/2192] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:41 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:41.540768 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810405-6905-428a-9fcf-cf976ae6273b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:41.550828 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810405-6905-428a-9fcf-cf976ae6273b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:41.555900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2feb55-e10e-469f-8e18-3d88eba1de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:41.556778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2feb55-e10e-469f-8e18-3d88eba1de55 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:41.557178 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2feb55-e10e-469f-8e18-3d88eba1de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:41.557551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2feb55-e10e-469f-8e18-3d88eba1de55 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:41.558453 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2feb55-e10e-469f-8e18-3d88eba1de55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:12:41.558846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2feb55-e10e-469f-8e18-3d88eba1de55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:41.588231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2feb55-e10e-469f-8e18-3d88eba1de55 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:41.601104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1085/2193] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:12:41.605447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1290827-1f48-4ec8-b95a-27d64ef5095c None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:41.615027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1290827-1f48-4ec8-b95a-27d64ef5095c None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:41.620440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f44a5-3398-4faa-be66-64f1126189fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:41.621035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f44a5-3398-4faa-be66-64f1126189fc admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:41.621322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f44a5-3398-4faa-be66-64f1126189fc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:41.621629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f44a5-3398-4faa-be66-64f1126189fc admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:41.622273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f44a5-3398-4faa-be66-64f1126189fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:41.652386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f44a5-3398-4faa-be66-64f1126189fc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:41.828677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1109/2194] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:41 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:41.830436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2feb55-e10e-469f-8e18-3d88eba1de55 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:41.841709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2feb55-e10e-469f-8e18-3d88eba1de55 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:41.910329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579fd50-e9f8-47da-b2bb-b7f809d9caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:41.910931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579fd50-e9f8-47da-b2bb-b7f809d9caa2 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:41.911222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579fd50-e9f8-47da-b2bb-b7f809d9caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:41.911545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579fd50-e9f8-47da-b2bb-b7f809d9caa2 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:41.912189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579fd50-e9f8-47da-b2bb-b7f809d9caa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:41.938732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579fd50-e9f8-47da-b2bb-b7f809d9caa2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:42.104341 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1086/2195] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:41 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:42.109030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f44a5-3398-4faa-be66-64f1126189fc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:42.122498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f44a5-3398-4faa-be66-64f1126189fc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:42.127590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bf4df-2308-4d22-aacb-20101aba5227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:42.128185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bf4df-2308-4d22-aacb-20101aba5227 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:42.128470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bf4df-2308-4d22-aacb-20101aba5227 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:42.128754 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bf4df-2308-4d22-aacb-20101aba5227 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:42.129445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bf4df-2308-4d22-aacb-20101aba5227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:42.156757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bf4df-2308-4d22-aacb-20101aba5227 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:42.172376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1110/2196] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:42.174082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579fd50-e9f8-47da-b2bb-b7f809d9caa2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:42.184715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579fd50-e9f8-47da-b2bb-b7f809d9caa2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:42.190363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d140e-73db-448e-9463-b9c24aa9ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:42.191358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d140e-73db-448e-9463-b9c24aa9ba84 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:42.191782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d140e-73db-448e-9463-b9c24aa9ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:42.192125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d140e-73db-448e-9463-b9c24aa9ba84 admin admin] PATH_INFO: `/v3/projects/b84503f156bf47bfa8a82d0f1f85e4fc/users/b1c5d44a48434f76bbf4a6032b2974cf/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:42.223338 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d140e-73db-448e-9463-b9c24aa9ba84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84503f156bf47bfa8a82d0f1f85e4fc, user_id=b1c5d44a48434f76bbf4a6032b2974cf, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:42.253479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d140e-73db-448e-9463-b9c24aa9ba84 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:42.375182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1087/2197] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:42 2022] PUT /identity/v3/projects/b84503f156bf47bfa8a82d0f1f85e4fc/users/b1c5d44a48434f76bbf4a6032b2974cf/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:42.386183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990839a-14a1-4aca-b397-fedd1cfd3d20 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:42.386478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990839a-14a1-4aca-b397-fedd1cfd3d20 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:42.386767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990839a-14a1-4aca-b397-fedd1cfd3d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:42.426575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c990839a-14a1-4aca-b397-fedd1cfd3d20 None None] MFA Rules not processed for user `b1c5d44a48434f76bbf4a6032b2974cf`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:42.427843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c990839a-14a1-4aca-b397-fedd1cfd3d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:42.504457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1111/2198] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:42.509418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d140e-73db-448e-9463-b9c24aa9ba84 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:42.595544 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d140e-73db-448e-9463-b9c24aa9ba84 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:42.600710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c97a9c-8da0-4d73-9e8b-e8f037985898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:42.600710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c97a9c-8da0-4d73-9e8b-e8f037985898 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:42.601131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c97a9c-8da0-4d73-9e8b-e8f037985898 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:42.601225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c97a9c-8da0-4d73-9e8b-e8f037985898 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:42.601872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c97a9c-8da0-4d73-9e8b-e8f037985898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:42.630010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c97a9c-8da0-4d73-9e8b-e8f037985898 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:42.742556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1088/2199] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:42 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:42.746570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990839a-14a1-4aca-b397-fedd1cfd3d20 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:42.760072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990839a-14a1-4aca-b397-fedd1cfd3d20 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:42.830306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5e8bd-c46c-4802-8708-ed6c14f323f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:42.830981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5e8bd-c46c-4802-8708-ed6c14f323f3 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:42.831186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5e8bd-c46c-4802-8708-ed6c14f323f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:42.831513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5e8bd-c46c-4802-8708-ed6c14f323f3 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:42.832161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5e8bd-c46c-4802-8708-ed6c14f323f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:42.858557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5e8bd-c46c-4802-8708-ed6c14f323f3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:42.964890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1112/2200] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:42 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:42.966161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c97a9c-8da0-4d73-9e8b-e8f037985898 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:42.978047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c97a9c-8da0-4d73-9e8b-e8f037985898 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:42.982206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df947fed-072d-4288-812a-9c2c3d08afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:42.982804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df947fed-072d-4288-812a-9c2c3d08afac admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:42.983085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df947fed-072d-4288-812a-9c2c3d08afac admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:42.983390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df947fed-072d-4288-812a-9c2c3d08afac admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:42.984335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df947fed-072d-4288-812a-9c2c3d08afac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:43.010286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df947fed-072d-4288-812a-9c2c3d08afac admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:43.023406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1089/2201] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:12:43.027985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5e8bd-c46c-4802-8708-ed6c14f323f3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:43.037912 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5e8bd-c46c-4802-8708-ed6c14f323f3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:43.042141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91a7d-5d8a-48e9-86a9-55bb5a693b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:43.042983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91a7d-5d8a-48e9-86a9-55bb5a693b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:43.043268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91a7d-5d8a-48e9-86a9-55bb5a693b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:43.043580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91a7d-5d8a-48e9-86a9-55bb5a693b8d admin admin] PATH_INFO: `/v3/projects/922fd4a124fe4af5bc3af6f931569ebf/users/52c9d6c093b54bfdbfde23d1e0067ef5/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:43.065271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f91a7d-5d8a-48e9-86a9-55bb5a693b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=922fd4a124fe4af5bc3af6f931569ebf, user_id=52c9d6c093b54bfdbfde23d1e0067ef5, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:43.092879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f91a7d-5d8a-48e9-86a9-55bb5a693b8d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:43.158246 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1113/2202] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:43 2022] PUT /identity/v3/projects/922fd4a124fe4af5bc3af6f931569ebf/users/52c9d6c093b54bfdbfde23d1e0067ef5/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:43.163819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df947fed-072d-4288-812a-9c2c3d08afac admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:43.174683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df947fed-072d-4288-812a-9c2c3d08afac admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:43.250604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b80fa-3f41-4b89-9e3b-5fb545f66bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:43.251475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b80fa-3f41-4b89-9e3b-5fb545f66bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:43.251769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b80fa-3f41-4b89-9e3b-5fb545f66bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:43.252055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b80fa-3f41-4b89-9e3b-5fb545f66bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:43.252755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b80fa-3f41-4b89-9e3b-5fb545f66bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:43.279227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6b80fa-3f41-4b89-9e3b-5fb545f66bb9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:43.292488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1090/2203] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:43.298440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91a7d-5d8a-48e9-86a9-55bb5a693b8d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:43.311369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91a7d-5d8a-48e9-86a9-55bb5a693b8d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:43.316867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c1e2b-c53c-4d23-8cd9-476f68e2273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:43.317685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c1e2b-c53c-4d23-8cd9-476f68e2273c admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:43.318092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c1e2b-c53c-4d23-8cd9-476f68e2273c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:43.318380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c1e2b-c53c-4d23-8cd9-476f68e2273c admin admin] PATH_INFO: `/v3/projects/922fd4a124fe4af5bc3af6f931569ebf/users/52c9d6c093b54bfdbfde23d1e0067ef5/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:43.320258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c1e2b-c53c-4d23-8cd9-476f68e2273c admin admin] RBAC: Authorizing `identity:create_grant(project_id=922fd4a124fe4af5bc3af6f931569ebf, user_id=52c9d6c093b54bfdbfde23d1e0067ef5, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:43.347505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c1e2b-c53c-4d23-8cd9-476f68e2273c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:43.364126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1114/2204] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:43 2022] PUT /identity/v3/projects/922fd4a124fe4af5bc3af6f931569ebf/users/52c9d6c093b54bfdbfde23d1e0067ef5/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:43.365550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b80fa-3f41-4b89-9e3b-5fb545f66bb9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:43.376703 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b80fa-3f41-4b89-9e3b-5fb545f66bb9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:43.445429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd55e-0b16-49d0-84a9-8481267b84fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:43.445954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd55e-0b16-49d0-84a9-8481267b84fa admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:43.446244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd55e-0b16-49d0-84a9-8481267b84fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:43.446531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd55e-0b16-49d0-84a9-8481267b84fa admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:43.447233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fd55e-0b16-49d0-84a9-8481267b84fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:43.473262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fd55e-0b16-49d0-84a9-8481267b84fa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:43.483353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1091/2205] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:43.488656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c1e2b-c53c-4d23-8cd9-476f68e2273c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:43.498473 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c1e2b-c53c-4d23-8cd9-476f68e2273c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:43.503626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df7695-5177-4727-bf51-ef411bb7da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:43.504447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df7695-5177-4727-bf51-ef411bb7da99 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:43.504718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df7695-5177-4727-bf51-ef411bb7da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:43.505031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df7695-5177-4727-bf51-ef411bb7da99 admin admin] PATH_INFO: `/v3/projects/922fd4a124fe4af5bc3af6f931569ebf/users/52c9d6c093b54bfdbfde23d1e0067ef5/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:43.506787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df7695-5177-4727-bf51-ef411bb7da99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922fd4a124fe4af5bc3af6f931569ebf, user_id=52c9d6c093b54bfdbfde23d1e0067ef5, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:43.533717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df7695-5177-4727-bf51-ef411bb7da99 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:43.610647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1115/2206] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:43 2022] PUT /identity/v3/projects/922fd4a124fe4af5bc3af6f931569ebf/users/52c9d6c093b54bfdbfde23d1e0067ef5/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:43.620775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941f1b1-2873-4d18-b488-af543c57fbf3 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:43.621295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941f1b1-2873-4d18-b488-af543c57fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:43.621443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941f1b1-2873-4d18-b488-af543c57fbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:43.658376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-9941f1b1-2873-4d18-b488-af543c57fbf3 None None] MFA Rules not processed for user `52c9d6c093b54bfdbfde23d1e0067ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:43.659578 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9941f1b1-2873-4d18-b488-af543c57fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:43.738507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1092/2207] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:43.747949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df7695-5177-4727-bf51-ef411bb7da99 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:43.749677 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-72df7695-5177-4727-bf51-ef411bb7da99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:43.819096 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df7695-5177-4727-bf51-ef411bb7da99 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:43.822490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3721e5-7f24-4f8d-836e-4c11b9a4985a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:43.823061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3721e5-7f24-4f8d-836e-4c11b9a4985a service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:43.823375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3721e5-7f24-4f8d-836e-4c11b9a4985a service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:43.823657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3721e5-7f24-4f8d-836e-4c11b9a4985a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:43.886404 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3721e5-7f24-4f8d-836e-4c11b9a4985a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:43.927252 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3721e5-7f24-4f8d-836e-4c11b9a4985a service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:43.941803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1116/2208] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:43 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:12:48.754921 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941f1b1-2873-4d18-b488-af543c57fbf3 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:48.758718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9941f1b1-2873-4d18-b488-af543c57fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:48.832501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941f1b1-2873-4d18-b488-af543c57fbf3 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:48.836710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:48.837501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:48.837808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:48.838046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] PATH_INFO: `/v3/users/61be93d2eb7e4c5d9565d812bb738223` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:48.839518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] RBAC: Authorizing `identity:delete_user(user_id=61be93d2eb7e4c5d9565d812bb738223)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:48.865821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:49.056345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61be93d2eb7e4c5d9565d812bb738223'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.069539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61be93d2eb7e4c5d9565d812bb738223'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.070201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61be93d2eb7e4c5d9565d812bb738223'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.078030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61be93d2eb7e4c5d9565d812bb738223'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.171457 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61be93d2eb7e4c5d9565d812bb738223'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.178514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1093/2209] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:48 2022] DELETE /identity/v3/users/61be93d2eb7e4c5d9565d812bb738223 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:49.507035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3721e5-7f24-4f8d-836e-4c11b9a4985a service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:49.518707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3721e5-7f24-4f8d-836e-4c11b9a4985a service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:49.584013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:49.584717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:49.585011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:49.585300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] PATH_INFO: `/v3/projects/5075a85e517e428ab3a0fa357d9344cb` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:49.586395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5075a85e517e428ab3a0fa357d9344cb)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:49.614107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:49.734931 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5075a85e517e428ab3a0fa357d9344cb', 'request_id': 'req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.819548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5075a85e517e428ab3a0fa357d9344cb', 'request_id': 'req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.832220 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5075a85e517e428ab3a0fa357d9344cb', 'request_id': 'req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.845819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] The token cache is being invalidate because project 5075a85e517e428ab3a0fa357d9344cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:49.845819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.845819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:49.845819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1117/2210] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:49 2022] DELETE /identity/v3/projects/5075a85e517e428ab3a0fa357d9344cb => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:49.849535 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:49.850932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:49.864955 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29522ce8-98f3-4fe1-aaaa-335b6ed2f70a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:49.930611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:49.931444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:49.931749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:49.932001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] PATH_INFO: `/v3/users/0d3f05168ba44251ba6861754f18b61e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:49.933116 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3f05168ba44251ba6861754f18b61e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:49.959510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:50.187535 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3f05168ba44251ba6861754f18b61e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.200147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3f05168ba44251ba6861754f18b61e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.200844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3f05168ba44251ba6861754f18b61e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.208550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3f05168ba44251ba6861754f18b61e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.291219 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b5486c86-e0e5-49d5-9d02-d57bd6bbd0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3f05168ba44251ba6861754f18b61e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.297595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1094/2211] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:12:49 2022] DELETE /identity/v3/users/0d3f05168ba44251ba6861754f18b61e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:50.596921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:50.598294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:50.611900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce8b03-0ab4-47ff-b203-e9c2c512caa5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:50.674469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:50.675178 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:50.675500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:50.675785 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] PATH_INFO: `/v3/projects/b098ed4575894784bdb1a7601d754d7c` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:50.676880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b098ed4575894784bdb1a7601d754d7c)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:50.702538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:50.838033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b098ed4575894784bdb1a7601d754d7c', 'request_id': 'req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.928064 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b098ed4575894784bdb1a7601d754d7c', 'request_id': 'req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.940126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b098ed4575894784bdb1a7601d754d7c', 'request_id': 'req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.950786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] The token cache is being invalidate because project b098ed4575894784bdb1a7601d754d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:12:50.951117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.951775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7f391647-a4a7-45ef-9c7a-9bb1021f63dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:12:50.953271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1118/2212] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:12:50 2022] DELETE /identity/v3/projects/b098ed4575894784bdb1a7601d754d7c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:12:50.961773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa1dbc-0038-4e07-bb50-d6d928c12e2f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:50.962300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa1dbc-0038-4e07-bb50-d6d928c12e2f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:50.962386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa1dbc-0038-4e07-bb50-d6d928c12e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:50.987018 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-31fa1dbc-0038-4e07-bb50-d6d928c12e2f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:50.988214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-31fa1dbc-0038-4e07-bb50-d6d928c12e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:51.055630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1095/2213] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:51.063844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e25db9-4de0-4491-9384-9c5c4fd42b2f None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:51.064053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e25db9-4de0-4491-9384-9c5c4fd42b2f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:51.064342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e25db9-4de0-4491-9384-9c5c4fd42b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:51.088881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-13e25db9-4de0-4491-9384-9c5c4fd42b2f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:51.090127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-13e25db9-4de0-4491-9384-9c5c4fd42b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:51.108702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1119/2214] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:12:51.110003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa1dbc-0038-4e07-bb50-d6d928c12e2f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:51.119951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa1dbc-0038-4e07-bb50-d6d928c12e2f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:51.124138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288d49-d772-475a-8833-c76eec978b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:51.124777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288d49-d772-475a-8833-c76eec978b8b admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:51.125074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288d49-d772-475a-8833-c76eec978b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:51.125342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288d49-d772-475a-8833-c76eec978b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:51.126687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f288d49-d772-475a-8833-c76eec978b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:12:51.126940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f288d49-d772-475a-8833-c76eec978b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:51.153181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f288d49-d772-475a-8833-c76eec978b8b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:51.166224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1096/2215] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:12:51.170553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e25db9-4de0-4491-9384-9c5c4fd42b2f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:51.179998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e25db9-4de0-4491-9384-9c5c4fd42b2f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:51.184271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15a983-6365-4263-83fb-c64a8fe41438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:51.184942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15a983-6365-4263-83fb-c64a8fe41438 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:51.185140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15a983-6365-4263-83fb-c64a8fe41438 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:51.185425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15a983-6365-4263-83fb-c64a8fe41438 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:51.186069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15a983-6365-4263-83fb-c64a8fe41438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:51.213233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15a983-6365-4263-83fb-c64a8fe41438 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:51.301288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1120/2216] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:12:51 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:51.305298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288d49-d772-475a-8833-c76eec978b8b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:51.315647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288d49-d772-475a-8833-c76eec978b8b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:51.378687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546ca03-adb1-4b1a-aea4-5ae295b2b3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:51.379285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546ca03-adb1-4b1a-aea4-5ae295b2b3df admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:51.379605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546ca03-adb1-4b1a-aea4-5ae295b2b3df admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:51.379886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f546ca03-adb1-4b1a-aea4-5ae295b2b3df admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:51.380534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546ca03-adb1-4b1a-aea4-5ae295b2b3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:51.407713 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f546ca03-adb1-4b1a-aea4-5ae295b2b3df admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:51.537551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1097/2217] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:12:51 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:12:51.541983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15a983-6365-4263-83fb-c64a8fe41438 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:51.553875 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15a983-6365-4263-83fb-c64a8fe41438 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:51.558315 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866f5df-a8a6-4784-b7f6-f31936c3fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:51.558944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866f5df-a8a6-4784-b7f6-f31936c3fbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:51.559238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866f5df-a8a6-4784-b7f6-f31936c3fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:51.559549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866f5df-a8a6-4784-b7f6-f31936c3fbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:51.560249 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866f5df-a8a6-4784-b7f6-f31936c3fbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:51.591265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0866f5df-a8a6-4784-b7f6-f31936c3fbc5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:51.602734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1121/2218] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:12:51.607166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546ca03-adb1-4b1a-aea4-5ae295b2b3df admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:51.619100 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f546ca03-adb1-4b1a-aea4-5ae295b2b3df admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:51.623635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5d814-792d-4970-a0ca-010d3669cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:51.624485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5d814-792d-4970-a0ca-010d3669cb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:51.624772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5d814-792d-4970-a0ca-010d3669cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:51.625056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5d814-792d-4970-a0ca-010d3669cb61 admin admin] PATH_INFO: `/v3/projects/88f4c7ccf7844c339b259178e39bf2f7/users/1c430bc20d2141e0b1cf513660c9ff7f/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:51.648119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5d814-792d-4970-a0ca-010d3669cb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f4c7ccf7844c339b259178e39bf2f7, user_id=1c430bc20d2141e0b1cf513660c9ff7f, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:51.676405 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5d814-792d-4970-a0ca-010d3669cb61 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:51.825391 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1098/2219] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:12:51 2022] PUT /identity/v3/projects/88f4c7ccf7844c339b259178e39bf2f7/users/1c430bc20d2141e0b1cf513660c9ff7f/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:12:51.836985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cb10f-1ba6-49d7-8cb8-656040f7db07 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:51.837285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cb10f-1ba6-49d7-8cb8-656040f7db07 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:51.837574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cb10f-1ba6-49d7-8cb8-656040f7db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:51.875219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-927cb10f-1ba6-49d7-8cb8-656040f7db07 None None] MFA Rules not processed for user `1c430bc20d2141e0b1cf513660c9ff7f`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:51.876996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-927cb10f-1ba6-49d7-8cb8-656040f7db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:51.950140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1122/2220] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:51.965428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9cbfa-944c-4a08-b62e-90d4ea01cb19 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:51.966010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9cbfa-944c-4a08-b62e-90d4ea01cb19 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:51.966104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9cbfa-944c-4a08-b62e-90d4ea01cb19 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:51.968115 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1099/2221] 10.222.0.87 () {54 vars in 956 bytes} [Tue Jan 18 13:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:12:51.974297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb12a-dc12-418a-b55e-5187c5989f7c None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:51.978011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb12a-dc12-418a-b55e-5187c5989f7c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:51.978011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9eb12a-dc12-418a-b55e-5187c5989f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:52.070292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1d9eb12a-dc12-418a-b55e-5187c5989f7c None None] MFA Rules not processed for user `1aecbdda2f524fbca580d99b3001bed4`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:12:52.070292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1d9eb12a-dc12-418a-b55e-5187c5989f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:12:52.166617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1123/2222] 10.222.0.87 () {58 vars in 1053 bytes} [Tue Jan 18 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:12:52.175391 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9cbfa-944c-4a08-b62e-90d4ea01cb19 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:12:52.187162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9cbfa-944c-4a08-b62e-90d4ea01cb19 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:12:52.191221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264d8d7-c98e-4497-bca0-d28ef35a8505 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aecbdda2f524fbca580d99b3001bed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:12:52.191835 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264d8d7-c98e-4497-bca0-d28ef35a8505 service glance] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:12:52.192147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264d8d7-c98e-4497-bca0-d28ef35a8505 service glance] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:12:52.192415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264d8d7-c98e-4497-bca0-d28ef35a8505 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:12:52.201672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264d8d7-c98e-4497-bca0-d28ef35a8505 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:12:52.228187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264d8d7-c98e-4497-bca0-d28ef35a8505 service glance] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:12:52.238806 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1100/2223] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:12:52 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:01.277530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eb12a-dc12-418a-b55e-5187c5989f7c None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:01.278928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1d9eb12a-dc12-418a-b55e-5187c5989f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:01.344116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9eb12a-dc12-418a-b55e-5187c5989f7c None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:01.349299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:01.349957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:01.350170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:01.350457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:01.352200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:01.443549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:01.499647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:01.520310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1124/2224] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:01 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:06.976394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264d8d7-c98e-4497-bca0-d28ef35a8505 service glance] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:06.977961 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c264d8d7-c98e-4497-bca0-d28ef35a8505 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:07.100463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264d8d7-c98e-4497-bca0-d28ef35a8505 service glance] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:07.105316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71332c5f-f3e9-4d75-90f0-6c0784d44f85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:07.105925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71332c5f-f3e9-4d75-90f0-6c0784d44f85 service placement] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:07.106205 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71332c5f-f3e9-4d75-90f0-6c0784d44f85 service placement] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:07.106489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71332c5f-f3e9-4d75-90f0-6c0784d44f85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:07.108160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-71332c5f-f3e9-4d75-90f0-6c0784d44f85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:07.120359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71332c5f-f3e9-4d75-90f0-6c0784d44f85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:07.147361 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71332c5f-f3e9-4d75-90f0-6c0784d44f85 service placement] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:07.158376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1101/2225] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:06 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:07.788760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:07.790088 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:07.867992 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f1edb-9146-4d9f-b1e0-2fa8218ef7bb service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:07.872213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:07.873017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:07.873308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:07.880235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] PATH_INFO: `/v3/users/49a8e329451b4d56b78855cea6510e7b` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:07.880235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a8e329451b4d56b78855cea6510e7b)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:07.909719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:08.225538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a8e329451b4d56b78855cea6510e7b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:08.226523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a8e329451b4d56b78855cea6510e7b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:08.234984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a8e329451b4d56b78855cea6510e7b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:08.247346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a8e329451b4d56b78855cea6510e7b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:08.327518 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a8e329451b4d56b78855cea6510e7b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:08.335374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1125/2226] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:13:07 2022] DELETE /identity/v3/users/49a8e329451b4d56b78855cea6510e7b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:13:08.339653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268c5d-6ca7-4103-8785-2d1dc862a3cd None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:08.340146 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268c5d-6ca7-4103-8785-2d1dc862a3cd None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:08.340367 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3268c5d-6ca7-4103-8785-2d1dc862a3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:08.364008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f3268c5d-6ca7-4103-8785-2d1dc862a3cd None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:08.365154 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f3268c5d-6ca7-4103-8785-2d1dc862a3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:08.433676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1102/2227] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:13:08.452193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:08.453544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:08.520059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c470b3-ec92-48c7-a7ec-bae061e7c597 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:08.523639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8266d-d540-40e7-b9b2-242fefb54508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:08.524222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8266d-d540-40e7-b9b2-242fefb54508 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:08.524544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8266d-d540-40e7-b9b2-242fefb54508 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:08.525039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8266d-d540-40e7-b9b2-242fefb54508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:08.535259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8266d-d540-40e7-b9b2-242fefb54508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:08.562483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8266d-d540-40e7-b9b2-242fefb54508 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:08.575612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38548e9-34df-4a9c-bb06-c1dda9c99594 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:08.575612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38548e9-34df-4a9c-bb06-c1dda9c99594 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:08.575612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38548e9-34df-4a9c-bb06-c1dda9c99594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:08.575932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1126/2228] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:08.598771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f38548e9-34df-4a9c-bb06-c1dda9c99594 None None] MFA Rules not processed for user `8415aa9435a543bbb93756ba5f706152`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:08.600233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f38548e9-34df-4a9c-bb06-c1dda9c99594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:08.671238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1103/2229] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:13:09.315640 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8266d-d540-40e7-b9b2-242fefb54508 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:09.317676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2bc8266d-d540-40e7-b9b2-242fefb54508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:09.333037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8266d-d540-40e7-b9b2-242fefb54508 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:09.337653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:09.338809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:09.339248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:09.339693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] PATH_INFO: `/v3/projects/f0a8691798534f86b2c96daec26342f1` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:09.341095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a8691798534f86b2c96daec26342f1)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:09.373877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:09.491617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38548e9-34df-4a9c-bb06-c1dda9c99594 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:09.493975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f38548e9-34df-4a9c-bb06-c1dda9c99594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:09.514975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a8691798534f86b2c96daec26342f1', 'request_id': 'req-5c53b19e-23ea-4730-8a28-2c628c2f9a12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:09.517988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38548e9-34df-4a9c-bb06-c1dda9c99594 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:09.597756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a8691798534f86b2c96daec26342f1', 'request_id': 'req-5c53b19e-23ea-4730-8a28-2c628c2f9a12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:09.597996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:09.597996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:09.597996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:09.597996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] PATH_INFO: `/v3/users/b1c5d44a48434f76bbf4a6032b2974cf` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:09.598884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c5d44a48434f76bbf4a6032b2974cf)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:09.600818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a8691798534f86b2c96daec26342f1', 'request_id': 'req-5c53b19e-23ea-4730-8a28-2c628c2f9a12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:09.611635 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] The token cache is being invalidate because project f0a8691798534f86b2c96daec26342f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:13:09.611925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:09.612563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5c53b19e-23ea-4730-8a28-2c628c2f9a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:09.614002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1127/2230] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:13:09 2022] DELETE /identity/v3/projects/f0a8691798534f86b2c96daec26342f1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:09.627727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:09.972816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c5d44a48434f76bbf4a6032b2974cf'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:09.984995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c5d44a48434f76bbf4a6032b2974cf'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:09.986094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c5d44a48434f76bbf4a6032b2974cf'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:09.996764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c5d44a48434f76bbf4a6032b2974cf'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:10.104901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c5d44a48434f76bbf4a6032b2974cf'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:10.112402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1104/2231] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:13:09 2022] DELETE /identity/v3/users/b1c5d44a48434f76bbf4a6032b2974cf => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:13:10.120424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9239e8-661b-4525-a0f0-2a4ea93c4152 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:10.120424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9239e8-661b-4525-a0f0-2a4ea93c4152 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:10.120424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9239e8-661b-4525-a0f0-2a4ea93c4152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:10.142857 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-3e9239e8-661b-4525-a0f0-2a4ea93c4152 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:10.144161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3e9239e8-661b-4525-a0f0-2a4ea93c4152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:10.212599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1128/2232] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:10 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:10.223024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:10.224510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:10.291900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff10871-b204-4afc-abf4-b34920bed9a8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:10.295488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63edc1c-ec2b-46fe-a573-11d34f4d0329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:10.296234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63edc1c-ec2b-46fe-a573-11d34f4d0329 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:10.296608 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63edc1c-ec2b-46fe-a573-11d34f4d0329 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:10.297021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63edc1c-ec2b-46fe-a573-11d34f4d0329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:10.308455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63edc1c-ec2b-46fe-a573-11d34f4d0329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:10.349468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63edc1c-ec2b-46fe-a573-11d34f4d0329 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:10.359592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1105/2233] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:10.949379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9239e8-661b-4525-a0f0-2a4ea93c4152 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:10.950784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3e9239e8-661b-4525-a0f0-2a4ea93c4152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:10.962961 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9239e8-661b-4525-a0f0-2a4ea93c4152 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:10.971748 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:10.972608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:10.972910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:10.973185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] PATH_INFO: `/v3/projects/b84503f156bf47bfa8a82d0f1f85e4fc` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:10.975630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84503f156bf47bfa8a82d0f1f85e4fc)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:11.026695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:11.159551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84503f156bf47bfa8a82d0f1f85e4fc', 'request_id': 'req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.224841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84503f156bf47bfa8a82d0f1f85e4fc', 'request_id': 'req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.239500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84503f156bf47bfa8a82d0f1f85e4fc', 'request_id': 'req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.249803 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] The token cache is being invalidate because project b84503f156bf47bfa8a82d0f1f85e4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:13:11.250093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.251016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.255374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1129/2234] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:13:10 2022] DELETE /identity/v3/projects/b84503f156bf47bfa8a82d0f1f85e4fc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:11.257202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63edc1c-ec2b-46fe-a573-11d34f4d0329 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:11.267582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63edc1c-ec2b-46fe-a573-11d34f4d0329 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:11.356060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:11.356887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:11.357203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:11.357483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] PATH_INFO: `/v3/users/52c9d6c093b54bfdbfde23d1e0067ef5` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:11.358572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c9d6c093b54bfdbfde23d1e0067ef5)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:11.385570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:11.643690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c9d6c093b54bfdbfde23d1e0067ef5'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.655832 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c9d6c093b54bfdbfde23d1e0067ef5'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.656629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c9d6c093b54bfdbfde23d1e0067ef5'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.667906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c9d6c093b54bfdbfde23d1e0067ef5'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.816887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fce47e30-8f02-419d-9032-e17603348601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c9d6c093b54bfdbfde23d1e0067ef5'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:11.823657 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1106/2235] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:13:11 2022] DELETE /identity/v3/users/52c9d6c093b54bfdbfde23d1e0067ef5 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:12.497923 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:12.499553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:12.516207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfa917-c404-4aa8-8f3e-16ecb119ffb4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:12.615878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:12.617214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:12.617214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:12.617214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] PATH_INFO: `/v3/projects/922fd4a124fe4af5bc3af6f931569ebf` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:12.618391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] RBAC: Authorizing `identity:delete_project(project_id=922fd4a124fe4af5bc3af6f931569ebf)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:12.647855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:12.812903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922fd4a124fe4af5bc3af6f931569ebf', 'request_id': 'req-eeff0492-56fb-494c-81a6-6c55ad69261d'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:12.916200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922fd4a124fe4af5bc3af6f931569ebf', 'request_id': 'req-eeff0492-56fb-494c-81a6-6c55ad69261d'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:13.012193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922fd4a124fe4af5bc3af6f931569ebf', 'request_id': 'req-eeff0492-56fb-494c-81a6-6c55ad69261d'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:13.030172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] The token cache is being invalidate because project 922fd4a124fe4af5bc3af6f931569ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:13:13.030536 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:13.031416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-eeff0492-56fb-494c-81a6-6c55ad69261d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:13.037145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1130/2236] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:13:12 2022] DELETE /identity/v3/projects/922fd4a124fe4af5bc3af6f931569ebf => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:13.042952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355e68-9d5d-404a-a04c-4d574fc297a8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:13.043482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355e68-9d5d-404a-a04c-4d574fc297a8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:13.043759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4355e68-9d5d-404a-a04c-4d574fc297a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:13.074406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-e4355e68-9d5d-404a-a04c-4d574fc297a8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:13.076202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e4355e68-9d5d-404a-a04c-4d574fc297a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:13.187588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1107/2237] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:13.196313 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272d871-158c-4dbc-bc97-e3233165e40b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:13.196863 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272d871-158c-4dbc-bc97-e3233165e40b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:13.201713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272d871-158c-4dbc-bc97-e3233165e40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:13.229837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-2272d871-158c-4dbc-bc97-e3233165e40b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:13.231043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2272d871-158c-4dbc-bc97-e3233165e40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:13.239523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1131/2238] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:13.243343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4355e68-9d5d-404a-a04c-4d574fc297a8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:13.255043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4355e68-9d5d-404a-a04c-4d574fc297a8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:13.265092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d71b4-a9e8-498b-8618-599106e87bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:13.265632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d71b4-a9e8-498b-8618-599106e87bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:13.265922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d71b4-a9e8-498b-8618-599106e87bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:13.266202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d71b4-a9e8-498b-8618-599106e87bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:13.268831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d71b4-a9e8-498b-8618-599106e87bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:13:13.269164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d71b4-a9e8-498b-8618-599106e87bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:13.296595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d71b4-a9e8-498b-8618-599106e87bd7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:13.310795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1108/2239] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:13:13.328343 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272d871-158c-4dbc-bc97-e3233165e40b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:13.349420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272d871-158c-4dbc-bc97-e3233165e40b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:13.368841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dfccc-73f9-4ac2-8f38-9893518c2997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:13.369722 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dfccc-73f9-4ac2-8f38-9893518c2997 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:13.370223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dfccc-73f9-4ac2-8f38-9893518c2997 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:13.370685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dfccc-73f9-4ac2-8f38-9893518c2997 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:13.371551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dfccc-73f9-4ac2-8f38-9893518c2997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:13.409112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dfccc-73f9-4ac2-8f38-9893518c2997 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:13.570074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1132/2240] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:13:13 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:13:13.572871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d71b4-a9e8-498b-8618-599106e87bd7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:13.586668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d71b4-a9e8-498b-8618-599106e87bd7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:13.666186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee87b7-4488-43e8-b74a-6fd0ada8ef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:13.667021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee87b7-4488-43e8-b74a-6fd0ada8ef51 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:13.667658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee87b7-4488-43e8-b74a-6fd0ada8ef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:13.668076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee87b7-4488-43e8-b74a-6fd0ada8ef51 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:13.668905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee87b7-4488-43e8-b74a-6fd0ada8ef51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:13.702549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee87b7-4488-43e8-b74a-6fd0ada8ef51 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:13.886808 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1109/2241] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:13:13 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:13:13.893337 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dfccc-73f9-4ac2-8f38-9893518c2997 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:13.908466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dfccc-73f9-4ac2-8f38-9893518c2997 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:13.912858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94883a0c-0040-4828-98ef-51dbfa818442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:13.913444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94883a0c-0040-4828-98ef-51dbfa818442 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:13.913921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94883a0c-0040-4828-98ef-51dbfa818442 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:13.917778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94883a0c-0040-4828-98ef-51dbfa818442 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:13.917778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94883a0c-0040-4828-98ef-51dbfa818442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:13.941362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94883a0c-0040-4828-98ef-51dbfa818442 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:13.953748 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1133/2242] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:13:13.958612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee87b7-4488-43e8-b74a-6fd0ada8ef51 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:13.968712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee87b7-4488-43e8-b74a-6fd0ada8ef51 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:13.974850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6f82-ba18-49cf-8277-7cbd662d5894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:13.975702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6f82-ba18-49cf-8277-7cbd662d5894 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:13.976011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6f82-ba18-49cf-8277-7cbd662d5894 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:13.976289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb6f82-ba18-49cf-8277-7cbd662d5894 admin admin] PATH_INFO: `/v3/projects/7c0ff34275e44f5d82d00091951a8ac9/users/8ab9c4fb20f4460b8db087b9e119040f/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:14.002372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6f82-ba18-49cf-8277-7cbd662d5894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0ff34275e44f5d82d00091951a8ac9, user_id=8ab9c4fb20f4460b8db087b9e119040f, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:14.029135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb6f82-ba18-49cf-8277-7cbd662d5894 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:14.166315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1110/2243] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:13:13 2022] PUT /identity/v3/projects/7c0ff34275e44f5d82d00091951a8ac9/users/8ab9c4fb20f4460b8db087b9e119040f/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:13:14.180499 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbace51d-849d-4105-a7c9-6396f3252f20 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:14.180801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbace51d-849d-4105-a7c9-6396f3252f20 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:14.181114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbace51d-849d-4105-a7c9-6396f3252f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:14.228030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-cbace51d-849d-4105-a7c9-6396f3252f20 None None] MFA Rules not processed for user `8ab9c4fb20f4460b8db087b9e119040f`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:14.229482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cbace51d-849d-4105-a7c9-6396f3252f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:14.338150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1134/2244] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:14.348975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6f82-ba18-49cf-8277-7cbd662d5894 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:14.350668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0fcb6f82-ba18-49cf-8277-7cbd662d5894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:14.440620 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb6f82-ba18-49cf-8277-7cbd662d5894 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:14.444194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9e978-89d4-4553-8a74-feaca88cf715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:14.444773 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e978-89d4-4553-8a74-feaca88cf715 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:14.445236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e978-89d4-4553-8a74-feaca88cf715 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:14.445967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9e978-89d4-4553-8a74-feaca88cf715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:14.455862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9e978-89d4-4553-8a74-feaca88cf715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:14.483078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9e978-89d4-4553-8a74-feaca88cf715 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:14.493254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1111/2245] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:14 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:35.266611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbace51d-849d-4105-a7c9-6396f3252f20 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:35.432982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbace51d-849d-4105-a7c9-6396f3252f20 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:35.438121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:35.441387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:35.441891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:35.442286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] PATH_INFO: `/v3/users/8ab9c4fb20f4460b8db087b9e119040f` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:35.443702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab9c4fb20f4460b8db087b9e119040f)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:35.478883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:35.998607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab9c4fb20f4460b8db087b9e119040f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:35.999591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab9c4fb20f4460b8db087b9e119040f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:36.010892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab9c4fb20f4460b8db087b9e119040f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:36.039592 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab9c4fb20f4460b8db087b9e119040f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:36.162576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab9c4fb20f4460b8db087b9e119040f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:36.175503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1135/2246] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:13:35 2022] DELETE /identity/v3/users/8ab9c4fb20f4460b8db087b9e119040f => generated 0 bytes in 908 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:36.179813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003d18-adf5-46bb-8fcf-d9f2151b79f4 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:36.181023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003d18-adf5-46bb-8fcf-d9f2151b79f4 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:36.182362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91003d18-adf5-46bb-8fcf-d9f2151b79f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:36.213526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-91003d18-adf5-46bb-8fcf-d9f2151b79f4 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:36.215238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-91003d18-adf5-46bb-8fcf-d9f2151b79f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:36.316853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1112/2247] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:36 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:36.328652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:36.331124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:36.421760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e98a41-d06f-439c-b6de-b56dcb779bbf admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:36.426238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32e07a-7a0e-4eae-954a-bf913f9bfae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:36.426818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32e07a-7a0e-4eae-954a-bf913f9bfae1 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:36.427107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32e07a-7a0e-4eae-954a-bf913f9bfae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:36.427415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32e07a-7a0e-4eae-954a-bf913f9bfae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:36.437696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32e07a-7a0e-4eae-954a-bf913f9bfae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:36.463981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32e07a-7a0e-4eae-954a-bf913f9bfae1 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:36.474155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1136/2248] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:36 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:37.250314 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91003d18-adf5-46bb-8fcf-d9f2151b79f4 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:37.252142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-91003d18-adf5-46bb-8fcf-d9f2151b79f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:37.269165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91003d18-adf5-46bb-8fcf-d9f2151b79f4 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:37.274544 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:37.275883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:37.276308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:37.276450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] PATH_INFO: `/v3/projects/7c0ff34275e44f5d82d00091951a8ac9` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:37.278290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0ff34275e44f5d82d00091951a8ac9)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:37.306092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:37.457290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0ff34275e44f5d82d00091951a8ac9', 'request_id': 'req-08ff1f75-5069-43c7-988c-130ef31ec71c'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:37.544780 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0ff34275e44f5d82d00091951a8ac9', 'request_id': 'req-08ff1f75-5069-43c7-988c-130ef31ec71c'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:37.557956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0ff34275e44f5d82d00091951a8ac9', 'request_id': 'req-08ff1f75-5069-43c7-988c-130ef31ec71c'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:37.569650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] The token cache is being invalidate because project 7c0ff34275e44f5d82d00091951a8ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:13:37.569932 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:37.570555 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-08ff1f75-5069-43c7-988c-130ef31ec71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:37.572008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1113/2249] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:13:37 2022] DELETE /identity/v3/projects/7c0ff34275e44f5d82d00091951a8ac9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:37.577680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc31a8-b8b7-484d-b258-903f60fcf860 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:37.578200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc31a8-b8b7-484d-b258-903f60fcf860 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:37.578280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc31a8-b8b7-484d-b258-903f60fcf860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:37.604271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-25dc31a8-b8b7-484d-b258-903f60fcf860 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:37.605423 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-25dc31a8-b8b7-484d-b258-903f60fcf860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:37.678563 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1137/2250] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:37.687007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d9ff-2da1-47a5-92b1-4f5071218ea5 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:37.687320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d9ff-2da1-47a5-92b1-4f5071218ea5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:37.687626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7057d9ff-2da1-47a5-92b1-4f5071218ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:37.711443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-7057d9ff-2da1-47a5-92b1-4f5071218ea5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:37.712594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7057d9ff-2da1-47a5-92b1-4f5071218ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:37.721474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1114/2251] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:13:37.724273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc31a8-b8b7-484d-b258-903f60fcf860 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:37.733879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc31a8-b8b7-484d-b258-903f60fcf860 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:37.738522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062231db-0135-4c78-ae13-3541ccd6c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:37.739122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062231db-0135-4c78-ae13-3541ccd6c8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:37.739443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062231db-0135-4c78-ae13-3541ccd6c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:37.739737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062231db-0135-4c78-ae13-3541ccd6c8c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:37.740482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062231db-0135-4c78-ae13-3541ccd6c8c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:13:37.740781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062231db-0135-4c78-ae13-3541ccd6c8c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:37.766777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062231db-0135-4c78-ae13-3541ccd6c8c1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:37.781822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1138/2252] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:13:37.786602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d9ff-2da1-47a5-92b1-4f5071218ea5 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:37.796241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7057d9ff-2da1-47a5-92b1-4f5071218ea5 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:37.800759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b1882-2171-4645-ab29-e036892a5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:37.801351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b1882-2171-4645-ab29-e036892a5888 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:37.803841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b1882-2171-4645-ab29-e036892a5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:37.803841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b1882-2171-4645-ab29-e036892a5888 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:37.803841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b1882-2171-4645-ab29-e036892a5888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:37.829476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b1882-2171-4645-ab29-e036892a5888 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:37.946807 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1115/2253] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:13:37 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:13:37.950927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062231db-0135-4c78-ae13-3541ccd6c8c1 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:37.960821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062231db-0135-4c78-ae13-3541ccd6c8c1 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:38.041037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e490b29-5cd4-4ec7-a593-0603d8f66b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:38.042069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e490b29-5cd4-4ec7-a593-0603d8f66b53 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:38.042592 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e490b29-5cd4-4ec7-a593-0603d8f66b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:38.043083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e490b29-5cd4-4ec7-a593-0603d8f66b53 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:38.044308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e490b29-5cd4-4ec7-a593-0603d8f66b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:38.081904 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e490b29-5cd4-4ec7-a593-0603d8f66b53 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:38.197971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1139/2254] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:13:37 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:13:38.202254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b1882-2171-4645-ab29-e036892a5888 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:38.212852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b1882-2171-4645-ab29-e036892a5888 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:38.217671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e170835-6f5d-4dd9-9944-0185ca585396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:38.218318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e170835-6f5d-4dd9-9944-0185ca585396 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:38.218604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e170835-6f5d-4dd9-9944-0185ca585396 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:38.218904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e170835-6f5d-4dd9-9944-0185ca585396 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:38.219630 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e170835-6f5d-4dd9-9944-0185ca585396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:38.246450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e170835-6f5d-4dd9-9944-0185ca585396 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:38.261607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1116/2255] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:13:38.263438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e490b29-5cd4-4ec7-a593-0603d8f66b53 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:38.274244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e490b29-5cd4-4ec7-a593-0603d8f66b53 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:38.278975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb25a7-96cc-430a-bc1d-b50382f920fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:38.279843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb25a7-96cc-430a-bc1d-b50382f920fa admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:38.280140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb25a7-96cc-430a-bc1d-b50382f920fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:38.280419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb25a7-96cc-430a-bc1d-b50382f920fa admin admin] PATH_INFO: `/v3/projects/1b1c286b84ed47eaaec86b88af7c5628/users/1b1eb45ea9874a97acc979858a229e5a/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:38.304614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb25a7-96cc-430a-bc1d-b50382f920fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1c286b84ed47eaaec86b88af7c5628, user_id=1b1eb45ea9874a97acc979858a229e5a, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:38.332507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb25a7-96cc-430a-bc1d-b50382f920fa admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:38.439257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1140/2256] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:13:38 2022] PUT /identity/v3/projects/1b1c286b84ed47eaaec86b88af7c5628/users/1b1eb45ea9874a97acc979858a229e5a/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:38.450190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae95449-dfc6-48c3-9132-8c8d47023494 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:38.450485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae95449-dfc6-48c3-9132-8c8d47023494 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:38.450771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae95449-dfc6-48c3-9132-8c8d47023494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:38.489888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-cae95449-dfc6-48c3-9132-8c8d47023494 None None] MFA Rules not processed for user `1b1eb45ea9874a97acc979858a229e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:38.491324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-cae95449-dfc6-48c3-9132-8c8d47023494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:38.576050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1117/2257] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:38 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:38.581594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb25a7-96cc-430a-bc1d-b50382f920fa admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:38.656828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb25a7-96cc-430a-bc1d-b50382f920fa admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:38.662246 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a72f88-3538-46a6-9b76-467cb365f572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:38.662844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a72f88-3538-46a6-9b76-467cb365f572 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:38.663131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a72f88-3538-46a6-9b76-467cb365f572 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:38.663465 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a72f88-3538-46a6-9b76-467cb365f572 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:38.664099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a72f88-3538-46a6-9b76-467cb365f572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:38.690151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a72f88-3538-46a6-9b76-467cb365f572 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:38.808990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1141/2258] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:13:38 2022] POST /identity/v3/projects => generated 383 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:13:38.813104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae95449-dfc6-48c3-9132-8c8d47023494 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:38.823721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae95449-dfc6-48c3-9132-8c8d47023494 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:38.887864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c5d82-99f9-491d-8807-491d1c30db0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:38.888481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c5d82-99f9-491d-8807-491d1c30db0f admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:38.888772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c5d82-99f9-491d-8807-491d1c30db0f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:38.889055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c5d82-99f9-491d-8807-491d1c30db0f admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:38.889708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c5d82-99f9-491d-8807-491d1c30db0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:38.918074 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831c5d82-99f9-491d-8807-491d1c30db0f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:39.020418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1118/2259] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:13:38 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:13:39.024400 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a72f88-3538-46a6-9b76-467cb365f572 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:39.034553 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a72f88-3538-46a6-9b76-467cb365f572 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:39.038883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19513512-ec0c-46b3-a7b0-0c61306d70d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:39.039505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513512-ec0c-46b3-a7b0-0c61306d70d3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:39.039799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513512-ec0c-46b3-a7b0-0c61306d70d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:39.040086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513512-ec0c-46b3-a7b0-0c61306d70d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:39.040773 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19513512-ec0c-46b3-a7b0-0c61306d70d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:39.066864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19513512-ec0c-46b3-a7b0-0c61306d70d3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:39.078445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1142/2260] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:13:39.083762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c5d82-99f9-491d-8807-491d1c30db0f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:39.093606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831c5d82-99f9-491d-8807-491d1c30db0f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:39.098693 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79070a-fa7a-4867-9a50-36c30aa3870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:39.099620 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79070a-fa7a-4867-9a50-36c30aa3870c admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:39.099994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79070a-fa7a-4867-9a50-36c30aa3870c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:39.100280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79070a-fa7a-4867-9a50-36c30aa3870c admin admin] PATH_INFO: `/v3/projects/6cf05dc5a7d14dcf9772a86e46aa5273/users/812998a1dffb406dab1b142a8844742d/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:39.121315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79070a-fa7a-4867-9a50-36c30aa3870c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf05dc5a7d14dcf9772a86e46aa5273, user_id=812998a1dffb406dab1b142a8844742d, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:39.149549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79070a-fa7a-4867-9a50-36c30aa3870c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:39.265235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1119/2261] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:13:39 2022] PUT /identity/v3/projects/6cf05dc5a7d14dcf9772a86e46aa5273/users/812998a1dffb406dab1b142a8844742d/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:13:39.277533 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b3dc-8de4-4e74-95b0-4e223e8367e9 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:39.277825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b3dc-8de4-4e74-95b0-4e223e8367e9 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:39.278107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b3dc-8de4-4e74-95b0-4e223e8367e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:39.320811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-4720b3dc-8de4-4e74-95b0-4e223e8367e9 None None] MFA Rules not processed for user `812998a1dffb406dab1b142a8844742d`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:39.322084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-4720b3dc-8de4-4e74-95b0-4e223e8367e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:39.411746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1143/2262] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:39 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:39.417753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79070a-fa7a-4867-9a50-36c30aa3870c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:39.504008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79070a-fa7a-4867-9a50-36c30aa3870c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:39.508439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00d0aa-c9af-427d-b9d6-8496eb3acd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:39.509296 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00d0aa-c9af-427d-b9d6-8496eb3acd3c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:39.509595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00d0aa-c9af-427d-b9d6-8496eb3acd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:39.509882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00d0aa-c9af-427d-b9d6-8496eb3acd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:39.510531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00d0aa-c9af-427d-b9d6-8496eb3acd3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:39.538109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00d0aa-c9af-427d-b9d6-8496eb3acd3c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:39.623700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1120/2263] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:13:39 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:13:39.625845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b3dc-8de4-4e74-95b0-4e223e8367e9 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:39.637126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b3dc-8de4-4e74-95b0-4e223e8367e9 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:39.710313 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bc206-8b44-4633-92f5-21b556ae0347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:39.710837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bc206-8b44-4633-92f5-21b556ae0347 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:39.711128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bc206-8b44-4633-92f5-21b556ae0347 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:39.711519 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708bc206-8b44-4633-92f5-21b556ae0347 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:39.712136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bc206-8b44-4633-92f5-21b556ae0347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:39.740402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708bc206-8b44-4633-92f5-21b556ae0347 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:39.825738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1144/2264] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:13:39 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:13:39.831741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00d0aa-c9af-427d-b9d6-8496eb3acd3c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:39.842689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00d0aa-c9af-427d-b9d6-8496eb3acd3c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:39.848845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6092e-98e2-47b2-90ff-baafd00288c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:39.849464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6092e-98e2-47b2-90ff-baafd00288c3 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:39.849753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6092e-98e2-47b2-90ff-baafd00288c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:39.850036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6092e-98e2-47b2-90ff-baafd00288c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:39.850743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6092e-98e2-47b2-90ff-baafd00288c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:39.895603 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6092e-98e2-47b2-90ff-baafd00288c3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:39.911702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1121/2265] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:13:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:13:39.916239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bc206-8b44-4633-92f5-21b556ae0347 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:39.927859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708bc206-8b44-4633-92f5-21b556ae0347 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:39.934423 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef913b4-2a06-4ba1-989d-4abd9c26d135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:39.935594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef913b4-2a06-4ba1-989d-4abd9c26d135 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:39.935888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef913b4-2a06-4ba1-989d-4abd9c26d135 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:39.936175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef913b4-2a06-4ba1-989d-4abd9c26d135 admin admin] PATH_INFO: `/v3/projects/48e6ec4f9a314efd872b0597e9d858de/users/e287c66e4be44455b38d8af655a15e52/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:39.957774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef913b4-2a06-4ba1-989d-4abd9c26d135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e6ec4f9a314efd872b0597e9d858de, user_id=e287c66e4be44455b38d8af655a15e52, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:39.985094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef913b4-2a06-4ba1-989d-4abd9c26d135 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:40.108550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1145/2266] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:13:39 2022] PUT /identity/v3/projects/48e6ec4f9a314efd872b0597e9d858de/users/e287c66e4be44455b38d8af655a15e52/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:40.113670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6092e-98e2-47b2-90ff-baafd00288c3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:40.123783 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6092e-98e2-47b2-90ff-baafd00288c3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:40.187034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0f873-40d4-4c48-b0c5-aa090f523e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:40.187664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0f873-40d4-4c48-b0c5-aa090f523e99 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:40.187950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0f873-40d4-4c48-b0c5-aa090f523e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:40.188236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0f873-40d4-4c48-b0c5-aa090f523e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:40.189000 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0f873-40d4-4c48-b0c5-aa090f523e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:40.215653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe0f873-40d4-4c48-b0c5-aa090f523e99 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:40.227054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1122/2267] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:13:40.231257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef913b4-2a06-4ba1-989d-4abd9c26d135 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:40.242121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef913b4-2a06-4ba1-989d-4abd9c26d135 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:40.246462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdcee1-b4dc-4ad9-9da6-85b8d1ba5fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:40.247289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdcee1-b4dc-4ad9-9da6-85b8d1ba5fce admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:40.247605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdcee1-b4dc-4ad9-9da6-85b8d1ba5fce admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:40.247889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdcee1-b4dc-4ad9-9da6-85b8d1ba5fce admin admin] PATH_INFO: `/v3/projects/48e6ec4f9a314efd872b0597e9d858de/users/e287c66e4be44455b38d8af655a15e52/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:40.249747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdcee1-b4dc-4ad9-9da6-85b8d1ba5fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e6ec4f9a314efd872b0597e9d858de, user_id=e287c66e4be44455b38d8af655a15e52, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:40.277479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdcee1-b4dc-4ad9-9da6-85b8d1ba5fce admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:40.290354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1146/2268] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:13:40 2022] PUT /identity/v3/projects/48e6ec4f9a314efd872b0597e9d858de/users/e287c66e4be44455b38d8af655a15e52/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:40.294950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0f873-40d4-4c48-b0c5-aa090f523e99 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:40.307621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0f873-40d4-4c48-b0c5-aa090f523e99 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:40.381988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eba0a-5df9-4342-ad76-d02d76e300fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:40.382597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eba0a-5df9-4342-ad76-d02d76e300fd admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:40.382884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eba0a-5df9-4342-ad76-d02d76e300fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:40.383175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eba0a-5df9-4342-ad76-d02d76e300fd admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:40.383903 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eba0a-5df9-4342-ad76-d02d76e300fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:40.412110 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eba0a-5df9-4342-ad76-d02d76e300fd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:40.423396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1123/2269] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:13:40.429557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdcee1-b4dc-4ad9-9da6-85b8d1ba5fce admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:40.442202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdcee1-b4dc-4ad9-9da6-85b8d1ba5fce admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:40.446570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5402ae-2e03-46cc-a837-7a3741349e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:40.447418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5402ae-2e03-46cc-a837-7a3741349e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:40.447738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5402ae-2e03-46cc-a837-7a3741349e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:40.448045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5402ae-2e03-46cc-a837-7a3741349e62 admin admin] PATH_INFO: `/v3/projects/48e6ec4f9a314efd872b0597e9d858de/users/e287c66e4be44455b38d8af655a15e52/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:40.449955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5402ae-2e03-46cc-a837-7a3741349e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e6ec4f9a314efd872b0597e9d858de, user_id=e287c66e4be44455b38d8af655a15e52, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:40.478788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5402ae-2e03-46cc-a837-7a3741349e62 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:40.657174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1147/2270] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:13:40 2022] PUT /identity/v3/projects/48e6ec4f9a314efd872b0597e9d858de/users/e287c66e4be44455b38d8af655a15e52/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:40.679180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53006382-c169-4018-8f03-78bb61b0231f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:40.679697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53006382-c169-4018-8f03-78bb61b0231f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:40.680164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53006382-c169-4018-8f03-78bb61b0231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:40.726131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-53006382-c169-4018-8f03-78bb61b0231f None None] MFA Rules not processed for user `e287c66e4be44455b38d8af655a15e52`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:40.745198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-53006382-c169-4018-8f03-78bb61b0231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:40.851440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1124/2271] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:40 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:13:40.863186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5402ae-2e03-46cc-a837-7a3741349e62 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:40.865314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-fc5402ae-2e03-46cc-a837-7a3741349e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:40.949185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5402ae-2e03-46cc-a837-7a3741349e62 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:40.953257 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152d512-1429-4aa0-8271-a3432efa3c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:40.954043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d512-1429-4aa0-8271-a3432efa3c9a service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:40.954425 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d512-1429-4aa0-8271-a3432efa3c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:40.954866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152d512-1429-4aa0-8271-a3432efa3c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:41.038472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152d512-1429-4aa0-8271-a3432efa3c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:41.064968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152d512-1429-4aa0-8271-a3432efa3c9a service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:41.074911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1148/2272] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:40 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:48.306752 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53006382-c169-4018-8f03-78bb61b0231f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:48.318513 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53006382-c169-4018-8f03-78bb61b0231f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:48.330811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9f291-3255-4193-84a5-cc55f6c1fae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:48.331784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f291-3255-4193-84a5-cc55f6c1fae6 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:48.332069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f291-3255-4193-84a5-cc55f6c1fae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:48.332345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f291-3255-4193-84a5-cc55f6c1fae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:48.402807 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9f291-3255-4193-84a5-cc55f6c1fae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:48.430593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9f291-3255-4193-84a5-cc55f6c1fae6 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:48.440488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1125/2273] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:48 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:49.787568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152d512-1429-4aa0-8271-a3432efa3c9a service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:49.788969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1152d512-1429-4aa0-8271-a3432efa3c9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:49.881581 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152d512-1429-4aa0-8271-a3432efa3c9a service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:49.887202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:49.887202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:49.887202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:49.887528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] PATH_INFO: `/v3/users/1c430bc20d2141e0b1cf513660c9ff7f` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:49.888449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c430bc20d2141e0b1cf513660c9ff7f)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:49.915524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:50.150713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c430bc20d2141e0b1cf513660c9ff7f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:50.151472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c430bc20d2141e0b1cf513660c9ff7f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:50.160347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c430bc20d2141e0b1cf513660c9ff7f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:50.172229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c430bc20d2141e0b1cf513660c9ff7f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:50.265408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c430bc20d2141e0b1cf513660c9ff7f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:50.277232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1149/2274] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:13:49 2022] DELETE /identity/v3/users/1c430bc20d2141e0b1cf513660c9ff7f => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:50.280999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf5f8d-367d-44e2-8200-1502d34a4d02 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:50.281545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf5f8d-367d-44e2-8200-1502d34a4d02 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:50.281856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf5f8d-367d-44e2-8200-1502d34a4d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:50.307613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c6bf5f8d-367d-44e2-8200-1502d34a4d02 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:50.308790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c6bf5f8d-367d-44e2-8200-1502d34a4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:50.394806 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1126/2275] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:50 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:50.405584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:50.408435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:50.505708 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616110c-4b06-4ab9-b699-fc3d2b9a6282 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:50.509562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddafd7a-984d-4e36-a8dc-498950209721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:50.510336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddafd7a-984d-4e36-a8dc-498950209721 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:50.511061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddafd7a-984d-4e36-a8dc-498950209721 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:50.511203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddafd7a-984d-4e36-a8dc-498950209721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:50.524918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddafd7a-984d-4e36-a8dc-498950209721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:50.552357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddafd7a-984d-4e36-a8dc-498950209721 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:50.568896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1150/2276] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:50 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:50.818162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf5f8d-367d-44e2-8200-1502d34a4d02 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:50.819583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c6bf5f8d-367d-44e2-8200-1502d34a4d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:50.957143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf5f8d-367d-44e2-8200-1502d34a4d02 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:50.967458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017858e-d748-4093-bf5f-868eabc2e2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:50.968063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017858e-d748-4093-bf5f-868eabc2e2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:50.968351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017858e-d748-4093-bf5f-868eabc2e2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:50.968635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017858e-d748-4093-bf5f-868eabc2e2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:50.970990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5017858e-d748-4093-bf5f-868eabc2e2f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:51.092833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017858e-d748-4093-bf5f-868eabc2e2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:51.130194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017858e-d748-4093-bf5f-868eabc2e2f3 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:51.146283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1127/2277] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:50 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:51.418302 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddafd7a-984d-4e36-a8dc-498950209721 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:51.420621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-4ddafd7a-984d-4e36-a8dc-498950209721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:51.437153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddafd7a-984d-4e36-a8dc-498950209721 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:51.443529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:51.444523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:51.445090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:51.445544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] PATH_INFO: `/v3/projects/88f4c7ccf7844c339b259178e39bf2f7` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:51.446798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f4c7ccf7844c339b259178e39bf2f7)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:51.474728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:51.691746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f4c7ccf7844c339b259178e39bf2f7', 'request_id': 'req-9aae65b0-69b0-44f3-a9a6-2748ec207c12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:51.827118 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f4c7ccf7844c339b259178e39bf2f7', 'request_id': 'req-9aae65b0-69b0-44f3-a9a6-2748ec207c12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:51.840298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f4c7ccf7844c339b259178e39bf2f7', 'request_id': 'req-9aae65b0-69b0-44f3-a9a6-2748ec207c12'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:51.853107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] The token cache is being invalidate because project 88f4c7ccf7844c339b259178e39bf2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:13:51.853686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:51.854474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9aae65b0-69b0-44f3-a9a6-2748ec207c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:51.856315 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1151/2278] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:13:51 2022] DELETE /identity/v3/projects/88f4c7ccf7844c339b259178e39bf2f7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:51.862357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b1929-04af-4de8-8923-41c6e637e093 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:51.862897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b1929-04af-4de8-8923-41c6e637e093 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:51.862897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b1929-04af-4de8-8923-41c6e637e093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:51.988188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-3e0b1929-04af-4de8-8923-41c6e637e093 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:51.989389 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-3e0b1929-04af-4de8-8923-41c6e637e093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:52.099337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1128/2279] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:52.113694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac6e3e-a057-4f7a-8ebc-b3201da7b6fd None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:52.114090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac6e3e-a057-4f7a-8ebc-b3201da7b6fd None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:52.114629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac6e3e-a057-4f7a-8ebc-b3201da7b6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:52.160839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-92ac6e3e-a057-4f7a-8ebc-b3201da7b6fd None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:52.163440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-92ac6e3e-a057-4f7a-8ebc-b3201da7b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:52.184624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1152/2280] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:52.185741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b1929-04af-4de8-8923-41c6e637e093 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:52.197585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b1929-04af-4de8-8923-41c6e637e093 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:52.203783 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef50e7-76f6-4cde-81cb-23228bb51936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:52.207241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef50e7-76f6-4cde-81cb-23228bb51936 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:52.207241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef50e7-76f6-4cde-81cb-23228bb51936 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:52.207241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef50e7-76f6-4cde-81cb-23228bb51936 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:52.207790 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef50e7-76f6-4cde-81cb-23228bb51936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:13:52.208232 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef50e7-76f6-4cde-81cb-23228bb51936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:52.240898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef50e7-76f6-4cde-81cb-23228bb51936 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:52.256680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1129/2281] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:13:52.261818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac6e3e-a057-4f7a-8ebc-b3201da7b6fd None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:52.272160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac6e3e-a057-4f7a-8ebc-b3201da7b6fd None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:52.277136 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecd0f3-1e44-4f16-b36d-f2f75c8bcccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:52.277840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecd0f3-1e44-4f16-b36d-f2f75c8bcccb admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:52.278200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecd0f3-1e44-4f16-b36d-f2f75c8bcccb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:52.278589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecd0f3-1e44-4f16-b36d-f2f75c8bcccb admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:52.279442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecd0f3-1e44-4f16-b36d-f2f75c8bcccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:52.313215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecd0f3-1e44-4f16-b36d-f2f75c8bcccb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:52.436398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef50e7-76f6-4cde-81cb-23228bb51936 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:52.437094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1153/2282] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:13:52 2022] POST /identity/v3/projects => generated 397 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:13:52.456837 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef50e7-76f6-4cde-81cb-23228bb51936 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:52.546889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a8a23-7f15-4f63-a225-f163515e149c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:52.547576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a8a23-7f15-4f63-a225-f163515e149c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:52.547862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a8a23-7f15-4f63-a225-f163515e149c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:52.549260 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a8a23-7f15-4f63-a225-f163515e149c admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:52.549872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a8a23-7f15-4f63-a225-f163515e149c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:52.577145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a8a23-7f15-4f63-a225-f163515e149c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:52.673889 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1130/2283] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:13:52 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:13:52.676566 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecd0f3-1e44-4f16-b36d-f2f75c8bcccb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:52.686870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecd0f3-1e44-4f16-b36d-f2f75c8bcccb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:52.692613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcda34-4ec5-4fc4-906b-9f249ed7998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:52.693216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcda34-4ec5-4fc4-906b-9f249ed7998f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:52.693498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcda34-4ec5-4fc4-906b-9f249ed7998f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:52.693780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcda34-4ec5-4fc4-906b-9f249ed7998f admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:52.694466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcda34-4ec5-4fc4-906b-9f249ed7998f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:52.720950 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcda34-4ec5-4fc4-906b-9f249ed7998f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:52.733185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1154/2284] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:13:52.738294 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a8a23-7f15-4f63-a225-f163515e149c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:52.756817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a8a23-7f15-4f63-a225-f163515e149c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:52.762862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e549105-10b3-4da7-9634-69eb661fe7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:52.764082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e549105-10b3-4da7-9634-69eb661fe7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:52.764432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e549105-10b3-4da7-9634-69eb661fe7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:52.764768 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e549105-10b3-4da7-9634-69eb661fe7d2 admin admin] PATH_INFO: `/v3/projects/5e6b35bd95ce4f4585d698485d4231ce/users/2aabadeb65414e27b50b34f08e132392/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:52.812517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e549105-10b3-4da7-9634-69eb661fe7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6b35bd95ce4f4585d698485d4231ce, user_id=2aabadeb65414e27b50b34f08e132392, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:52.852617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e549105-10b3-4da7-9634-69eb661fe7d2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:52.995107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f758f67-29b2-421f-9604-32d6a2f13b72 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:52.995433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f758f67-29b2-421f-9604-32d6a2f13b72 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:52.995718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f758f67-29b2-421f-9604-32d6a2f13b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:52.997372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1131/2285] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:13:52 2022] PUT /identity/v3/projects/5e6b35bd95ce4f4585d698485d4231ce/users/2aabadeb65414e27b50b34f08e132392/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:13:53.044197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-3f758f67-29b2-421f-9604-32d6a2f13b72 None None] MFA Rules not processed for user `2aabadeb65414e27b50b34f08e132392`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:53.045414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3f758f67-29b2-421f-9604-32d6a2f13b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:53.148777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1155/2286] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:52 2022] POST /identity/v3/auth/tokens => generated 3704 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:53.405264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e549105-10b3-4da7-9634-69eb661fe7d2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:53.408331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5e549105-10b3-4da7-9634-69eb661fe7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:53.482584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e549105-10b3-4da7-9634-69eb661fe7d2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:53.486395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cfa32-5523-431e-a9f5-6d1e81a05cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:53.487059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfa32-5523-431e-a9f5-6d1e81a05cba service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:53.487374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfa32-5523-431e-a9f5-6d1e81a05cba service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:53.487661 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9cfa32-5523-431e-a9f5-6d1e81a05cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:53.496472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cfa32-5523-431e-a9f5-6d1e81a05cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:53.522727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9cfa32-5523-431e-a9f5-6d1e81a05cba service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:53.534616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1132/2287] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:13:53 2022] GET /identity/v3/auth/tokens => generated 3704 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:13:57.581353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f758f67-29b2-421f-9604-32d6a2f13b72 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:57.583503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3f758f67-29b2-421f-9604-32d6a2f13b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:57.658619 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f758f67-29b2-421f-9604-32d6a2f13b72 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:57.663676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:57.664471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:57.664771 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:57.665054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] PATH_INFO: `/v3/users/28f976b0f7eb49008f26df866244e9d7` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:57.666227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f976b0f7eb49008f26df866244e9d7)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:57.694166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:57.978608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f976b0f7eb49008f26df866244e9d7'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:57.979365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f976b0f7eb49008f26df866244e9d7'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:57.987723 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f976b0f7eb49008f26df866244e9d7'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:58.001312 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f976b0f7eb49008f26df866244e9d7'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:58.104586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73bfa40e-a334-43f6-845c-13b2c3726f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f976b0f7eb49008f26df866244e9d7'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:58.114655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1156/2288] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:13:57 2022] DELETE /identity/v3/users/28f976b0f7eb49008f26df866244e9d7 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:58.534385 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cfa32-5523-431e-a9f5-6d1e81a05cba service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:58.549894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9cfa32-5523-431e-a9f5-6d1e81a05cba service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:58.615818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:58.616615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:58.616898 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:58.617174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] PATH_INFO: `/v3/projects/f8a6ebddf5974a7cb6da6cb755f28e87` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:58.618268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a6ebddf5974a7cb6da6cb755f28e87)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:58.644593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:58.814127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a6ebddf5974a7cb6da6cb755f28e87', 'request_id': 'req-e9dcb3d4-4b09-4a86-b955-7888423dfc89'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:58.938372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a6ebddf5974a7cb6da6cb755f28e87', 'request_id': 'req-e9dcb3d4-4b09-4a86-b955-7888423dfc89'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:58.952619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a6ebddf5974a7cb6da6cb755f28e87', 'request_id': 'req-e9dcb3d4-4b09-4a86-b955-7888423dfc89'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:58.962856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] The token cache is being invalidate because project f8a6ebddf5974a7cb6da6cb755f28e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:13:58.963148 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:58.963762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e9dcb3d4-4b09-4a86-b955-7888423dfc89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:13:58.965230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1133/2289] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:13:58 2022] DELETE /identity/v3/projects/f8a6ebddf5974a7cb6da6cb755f28e87 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:58.970918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f6555-166a-40c6-9a73-4c08ba2dcff5 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:58.971504 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f6555-166a-40c6-9a73-4c08ba2dcff5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:58.971602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f6555-166a-40c6-9a73-4c08ba2dcff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:58.994440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b83f6555-166a-40c6-9a73-4c08ba2dcff5 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:58.995605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b83f6555-166a-40c6-9a73-4c08ba2dcff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:59.063380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1157/2290] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:58 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:13:59.071662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc8eed-6b2b-4f7a-93bb-0118fd73840f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:59.071951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc8eed-6b2b-4f7a-93bb-0118fd73840f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:59.072239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc8eed-6b2b-4f7a-93bb-0118fd73840f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:59.103300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c7bc8eed-6b2b-4f7a-93bb-0118fd73840f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:59.103300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c7bc8eed-6b2b-4f7a-93bb-0118fd73840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:13:59.104362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1134/2291] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:13:59.108456 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f6555-166a-40c6-9a73-4c08ba2dcff5 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:59.119069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f6555-166a-40c6-9a73-4c08ba2dcff5 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:59.123524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce75097-2af1-45d8-8860-bcc20438bc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:59.124122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce75097-2af1-45d8-8860-bcc20438bc9e admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:59.124409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce75097-2af1-45d8-8860-bcc20438bc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:59.124693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce75097-2af1-45d8-8860-bcc20438bc9e admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:59.125380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce75097-2af1-45d8-8860-bcc20438bc9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:13:59.125708 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce75097-2af1-45d8-8860-bcc20438bc9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:59.152650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce75097-2af1-45d8-8860-bcc20438bc9e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:59.169429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1158/2292] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:13:59.174188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc8eed-6b2b-4f7a-93bb-0118fd73840f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:59.184020 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc8eed-6b2b-4f7a-93bb-0118fd73840f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:59.188245 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced3c75-3240-4d7e-8b6b-5e836b60b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:59.188888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced3c75-3240-4d7e-8b6b-5e836b60b658 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:59.189109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced3c75-3240-4d7e-8b6b-5e836b60b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:59.189387 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced3c75-3240-4d7e-8b6b-5e836b60b658 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:59.190014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced3c75-3240-4d7e-8b6b-5e836b60b658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:59.227883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced3c75-3240-4d7e-8b6b-5e836b60b658 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:59.328692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1135/2293] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:13:59 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:13:59.334082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce75097-2af1-45d8-8860-bcc20438bc9e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:59.356332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce75097-2af1-45d8-8860-bcc20438bc9e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:59.433634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455d562-15b1-4919-b376-d1ff7a839c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:59.434350 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455d562-15b1-4919-b376-d1ff7a839c22 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:59.434746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455d562-15b1-4919-b376-d1ff7a839c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:59.435097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455d562-15b1-4919-b376-d1ff7a839c22 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:59.436059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455d562-15b1-4919-b376-d1ff7a839c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:59.462460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455d562-15b1-4919-b376-d1ff7a839c22 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:59.573829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1159/2294] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:13:59 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:13:59.576573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced3c75-3240-4d7e-8b6b-5e836b60b658 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:59.588207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced3c75-3240-4d7e-8b6b-5e836b60b658 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:59.602322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663869b4-ff14-49d1-9e47-2a68a927f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:59.603974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663869b4-ff14-49d1-9e47-2a68a927f6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:59.604286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663869b4-ff14-49d1-9e47-2a68a927f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:59.604607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663869b4-ff14-49d1-9e47-2a68a927f6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:59.605343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663869b4-ff14-49d1-9e47-2a68a927f6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:59.634425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663869b4-ff14-49d1-9e47-2a68a927f6f8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:59.649478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1136/2295] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:13:59.651173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455d562-15b1-4919-b376-d1ff7a839c22 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:13:59.667167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455d562-15b1-4919-b376-d1ff7a839c22 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:13:59.674572 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f4d64-59d0-4835-b080-c1eea5515c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:13:59.675429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f4d64-59d0-4835-b080-c1eea5515c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:59.675715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f4d64-59d0-4835-b080-c1eea5515c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:59.675986 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f4d64-59d0-4835-b080-c1eea5515c4b admin admin] PATH_INFO: `/v3/projects/b11b9fa7100e462ebcd47a9f408e5b72/users/7aca1c7651b9454c8ab8dbcdb81e9ca6/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:59.699329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f4d64-59d0-4835-b080-c1eea5515c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b11b9fa7100e462ebcd47a9f408e5b72, user_id=7aca1c7651b9454c8ab8dbcdb81e9ca6, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:13:59.726774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f4d64-59d0-4835-b080-c1eea5515c4b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:13:59.869139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1160/2296] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:13:59 2022] PUT /identity/v3/projects/b11b9fa7100e462ebcd47a9f408e5b72/users/7aca1c7651b9454c8ab8dbcdb81e9ca6/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:13:59.881439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94a6aa-e2ff-4359-b5d6-3a2bdca5ee43 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:13:59.881760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94a6aa-e2ff-4359-b5d6-3a2bdca5ee43 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:13:59.882054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94a6aa-e2ff-4359-b5d6-3a2bdca5ee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:13:59.951194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ba94a6aa-e2ff-4359-b5d6-3a2bdca5ee43 None None] MFA Rules not processed for user `7aca1c7651b9454c8ab8dbcdb81e9ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:13:59.953240 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ba94a6aa-e2ff-4359-b5d6-3a2bdca5ee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:00.044629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1137/2297] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:00.049201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f4d64-59d0-4835-b080-c1eea5515c4b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:00.129224 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f4d64-59d0-4835-b080-c1eea5515c4b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:00.134732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4940be-fb5c-4df3-bcd9-568fc5215918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:00.135370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4940be-fb5c-4df3-bcd9-568fc5215918 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:00.135688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4940be-fb5c-4df3-bcd9-568fc5215918 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:00.135972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4940be-fb5c-4df3-bcd9-568fc5215918 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:00.136642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4940be-fb5c-4df3-bcd9-568fc5215918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:00.162584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4940be-fb5c-4df3-bcd9-568fc5215918 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:00.274957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1161/2298] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:00 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:00.279242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94a6aa-e2ff-4359-b5d6-3a2bdca5ee43 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:00.290743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94a6aa-e2ff-4359-b5d6-3a2bdca5ee43 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:00.367992 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950522-b493-4c0d-9356-eba167c37393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:00.368952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950522-b493-4c0d-9356-eba167c37393 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:00.369416 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950522-b493-4c0d-9356-eba167c37393 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:00.369866 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e950522-b493-4c0d-9356-eba167c37393 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:00.371334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950522-b493-4c0d-9356-eba167c37393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:00.422609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e950522-b493-4c0d-9356-eba167c37393 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:00.529330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1138/2299] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:00 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:14:00.531971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4940be-fb5c-4df3-bcd9-568fc5215918 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:00.543529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4940be-fb5c-4df3-bcd9-568fc5215918 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:00.548883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cdbae-e098-4633-b7af-3f289f56c4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:00.549927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cdbae-e098-4633-b7af-3f289f56c4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:00.550571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cdbae-e098-4633-b7af-3f289f56c4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:00.552594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cdbae-e098-4633-b7af-3f289f56c4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:00.564463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cdbae-e098-4633-b7af-3f289f56c4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:00.589911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cdbae-e098-4633-b7af-3f289f56c4e9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:00.602422 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1162/2300] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:00.606562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950522-b493-4c0d-9356-eba167c37393 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:00.617554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e950522-b493-4c0d-9356-eba167c37393 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:00.622063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f906f2-965f-4026-b4d9-e0c6ee1727aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:00.622888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f906f2-965f-4026-b4d9-e0c6ee1727aa admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:00.628578 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f906f2-965f-4026-b4d9-e0c6ee1727aa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:00.628578 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f906f2-965f-4026-b4d9-e0c6ee1727aa admin admin] PATH_INFO: `/v3/projects/9dd34e2a00724b869afbc8d4907efc76/users/b269c65cb4d34d529d0a726abd769b3a/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:00.645135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f906f2-965f-4026-b4d9-e0c6ee1727aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd34e2a00724b869afbc8d4907efc76, user_id=b269c65cb4d34d529d0a726abd769b3a, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:00.672528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f906f2-965f-4026-b4d9-e0c6ee1727aa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:00.773833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1139/2301] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:00 2022] PUT /identity/v3/projects/9dd34e2a00724b869afbc8d4907efc76/users/b269c65cb4d34d529d0a726abd769b3a/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:00.778133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cdbae-e098-4633-b7af-3f289f56c4e9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:00.788246 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cdbae-e098-4633-b7af-3f289f56c4e9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:00.862176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77023c4-477c-4d2d-82b5-339fc28413c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:00.862769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77023c4-477c-4d2d-82b5-339fc28413c5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:00.863053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77023c4-477c-4d2d-82b5-339fc28413c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:00.863369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77023c4-477c-4d2d-82b5-339fc28413c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:00.864319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77023c4-477c-4d2d-82b5-339fc28413c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:00.890426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77023c4-477c-4d2d-82b5-339fc28413c5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:00.901591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1163/2302] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:00.905777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f906f2-965f-4026-b4d9-e0c6ee1727aa admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:00.916427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f906f2-965f-4026-b4d9-e0c6ee1727aa admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:00.920725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0774cd-ab42-43c6-9a94-54eee3c95122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:00.921540 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0774cd-ab42-43c6-9a94-54eee3c95122 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:00.921824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0774cd-ab42-43c6-9a94-54eee3c95122 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:00.922103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0774cd-ab42-43c6-9a94-54eee3c95122 admin admin] PATH_INFO: `/v3/projects/9dd34e2a00724b869afbc8d4907efc76/users/b269c65cb4d34d529d0a726abd769b3a/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:00.923877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0774cd-ab42-43c6-9a94-54eee3c95122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd34e2a00724b869afbc8d4907efc76, user_id=b269c65cb4d34d529d0a726abd769b3a, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:00.950253 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0774cd-ab42-43c6-9a94-54eee3c95122 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:00.961480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1140/2303] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:00 2022] PUT /identity/v3/projects/9dd34e2a00724b869afbc8d4907efc76/users/b269c65cb4d34d529d0a726abd769b3a/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:00.965315 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77023c4-477c-4d2d-82b5-339fc28413c5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:00.975644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77023c4-477c-4d2d-82b5-339fc28413c5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:01.045383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f0353-1140-402c-ba19-5f6f3d28924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:01.046071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f0353-1140-402c-ba19-5f6f3d28924f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:01.046368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f0353-1140-402c-ba19-5f6f3d28924f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:01.046654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f0353-1140-402c-ba19-5f6f3d28924f admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:01.047410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f0353-1140-402c-ba19-5f6f3d28924f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:01.074633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f0353-1140-402c-ba19-5f6f3d28924f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:01.089951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1164/2304] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:14:01.091623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0774cd-ab42-43c6-9a94-54eee3c95122 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:01.103214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0774cd-ab42-43c6-9a94-54eee3c95122 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:01.107791 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8777ab-c761-45a8-8139-436a040724b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:01.108620 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8777ab-c761-45a8-8139-436a040724b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:01.108910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8777ab-c761-45a8-8139-436a040724b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:01.109196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8777ab-c761-45a8-8139-436a040724b8 admin admin] PATH_INFO: `/v3/projects/9dd34e2a00724b869afbc8d4907efc76/users/b269c65cb4d34d529d0a726abd769b3a/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:01.111181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8777ab-c761-45a8-8139-436a040724b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd34e2a00724b869afbc8d4907efc76, user_id=b269c65cb4d34d529d0a726abd769b3a, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:01.146841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8777ab-c761-45a8-8139-436a040724b8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:01.243165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1141/2305] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:01 2022] PUT /identity/v3/projects/9dd34e2a00724b869afbc8d4907efc76/users/b269c65cb4d34d529d0a726abd769b3a/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:01.252927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eca104-bc68-46f1-bd12-5ffd717d8288 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:01.253227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eca104-bc68-46f1-bd12-5ffd717d8288 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:01.253567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eca104-bc68-46f1-bd12-5ffd717d8288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:01.290411 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-54eca104-bc68-46f1-bd12-5ffd717d8288 None None] MFA Rules not processed for user `b269c65cb4d34d529d0a726abd769b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:01.291499 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-54eca104-bc68-46f1-bd12-5ffd717d8288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:01.365336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1165/2306] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3761 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:01.375109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8777ab-c761-45a8-8139-436a040724b8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:01.376856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5c8777ab-c761-45a8-8139-436a040724b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:01.444818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8777ab-c761-45a8-8139-436a040724b8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:01.448562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591b652-d0b0-4f7e-ac5c-9b44f71b861b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:01.449145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591b652-d0b0-4f7e-ac5c-9b44f71b861b service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:01.449432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591b652-d0b0-4f7e-ac5c-9b44f71b861b service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:01.449715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591b652-d0b0-4f7e-ac5c-9b44f71b861b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:01.460539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591b652-d0b0-4f7e-ac5c-9b44f71b861b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:01.487164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591b652-d0b0-4f7e-ac5c-9b44f71b861b service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:01.498192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1142/2307] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:01 2022] GET /identity/v3/auth/tokens => generated 3761 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:01.565105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eca104-bc68-46f1-bd12-5ffd717d8288 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:01.646260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eca104-bc68-46f1-bd12-5ffd717d8288 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:01.651480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:01.652463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:01.652760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:01.653046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] PATH_INFO: `/v3/users/7aca1c7651b9454c8ab8dbcdb81e9ca6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:01.654308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aca1c7651b9454c8ab8dbcdb81e9ca6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:01.682795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:01.933001 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aca1c7651b9454c8ab8dbcdb81e9ca6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:01.934161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aca1c7651b9454c8ab8dbcdb81e9ca6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:01.944140 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aca1c7651b9454c8ab8dbcdb81e9ca6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:01.955775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aca1c7651b9454c8ab8dbcdb81e9ca6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:02.064132 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aca1c7651b9454c8ab8dbcdb81e9ca6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:02.072175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1166/2308] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:01 2022] DELETE /identity/v3/users/7aca1c7651b9454c8ab8dbcdb81e9ca6 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:02.077524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ddfa8-8db6-4803-abeb-4fee13a6dad3 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:02.078760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ddfa8-8db6-4803-abeb-4fee13a6dad3 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:02.078760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ddfa8-8db6-4803-abeb-4fee13a6dad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:02.102064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-486ddfa8-8db6-4803-abeb-4fee13a6dad3 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:02.103278 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-486ddfa8-8db6-4803-abeb-4fee13a6dad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:02.182984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1143/2309] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:02 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:14:02.193616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:02.195063 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:02.266710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8327251-03e9-4cd5-864d-b07d1bc0083c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:02.270342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af9d3-701c-441a-8ca1-09794d75237a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:02.271708 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af9d3-701c-441a-8ca1-09794d75237a service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:02.271850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af9d3-701c-441a-8ca1-09794d75237a service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:02.272216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af9d3-701c-441a-8ca1-09794d75237a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:02.282010 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af9d3-701c-441a-8ca1-09794d75237a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:02.308172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af9d3-701c-441a-8ca1-09794d75237a service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:02.318540 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1167/2310] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:02.917221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ddfa8-8db6-4803-abeb-4fee13a6dad3 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:02.918709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-486ddfa8-8db6-4803-abeb-4fee13a6dad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:02.930029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ddfa8-8db6-4803-abeb-4fee13a6dad3 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:02.934924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:02.935999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:02.936345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:02.936635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] PATH_INFO: `/v3/projects/b11b9fa7100e462ebcd47a9f408e5b72` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:02.938057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b11b9fa7100e462ebcd47a9f408e5b72)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:02.964886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:03.102923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b11b9fa7100e462ebcd47a9f408e5b72', 'request_id': 'req-361ee743-9c17-4d85-ad50-3a73f2a3a467'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.249686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b11b9fa7100e462ebcd47a9f408e5b72', 'request_id': 'req-361ee743-9c17-4d85-ad50-3a73f2a3a467'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.261803 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b11b9fa7100e462ebcd47a9f408e5b72', 'request_id': 'req-361ee743-9c17-4d85-ad50-3a73f2a3a467'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.272774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] The token cache is being invalidate because project b11b9fa7100e462ebcd47a9f408e5b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:03.273053 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.273668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.275506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1144/2311] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:02 2022] DELETE /identity/v3/projects/b11b9fa7100e462ebcd47a9f408e5b72 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:03.279378 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af9d3-701c-441a-8ca1-09794d75237a service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:03.289667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af9d3-701c-441a-8ca1-09794d75237a service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:03.357461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:03.358356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:03.359141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:03.359141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] PATH_INFO: `/v3/users/b269c65cb4d34d529d0a726abd769b3a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:03.369913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b269c65cb4d34d529d0a726abd769b3a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:03.386870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:03.694676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b269c65cb4d34d529d0a726abd769b3a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.694676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b269c65cb4d34d529d0a726abd769b3a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.699629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b269c65cb4d34d529d0a726abd769b3a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.712296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b269c65cb4d34d529d0a726abd769b3a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.836145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-07c59bed-77d8-4a83-89a7-dd0c7b091c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b269c65cb4d34d529d0a726abd769b3a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:03.843174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1168/2312] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:03 2022] DELETE /identity/v3/users/b269c65cb4d34d529d0a726abd769b3a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:04.500596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:04.502125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:04.515198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ee743-9c17-4d85-ad50-3a73f2a3a467 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:04.594876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:04.595726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:04.596011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:04.596291 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] PATH_INFO: `/v3/projects/9dd34e2a00724b869afbc8d4907efc76` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:04.597477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd34e2a00724b869afbc8d4907efc76)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:04.625466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:04.752532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd34e2a00724b869afbc8d4907efc76', 'request_id': 'req-85582f16-c3fc-4c4f-b822-7b43e1e250f9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:04.850341 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd34e2a00724b869afbc8d4907efc76', 'request_id': 'req-85582f16-c3fc-4c4f-b822-7b43e1e250f9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:04.866589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd34e2a00724b869afbc8d4907efc76', 'request_id': 'req-85582f16-c3fc-4c4f-b822-7b43e1e250f9'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:04.877404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] The token cache is being invalidate because project 9dd34e2a00724b869afbc8d4907efc76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:04.877692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:04.878322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-85582f16-c3fc-4c4f-b822-7b43e1e250f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:04.880301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1145/2313] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:04 2022] DELETE /identity/v3/projects/9dd34e2a00724b869afbc8d4907efc76 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:04.885742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da904-fee6-4270-a69a-4f40372afa9b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:04.886293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da904-fee6-4270-a69a-4f40372afa9b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:04.886293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1da904-fee6-4270-a69a-4f40372afa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:04.911612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-be1da904-fee6-4270-a69a-4f40372afa9b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:04.913181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-be1da904-fee6-4270-a69a-4f40372afa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:04.985787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1169/2314] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:04.994248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c7140-9a94-4d57-9b39-8ffc6545dbf1 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:04.994537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c7140-9a94-4d57-9b39-8ffc6545dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:04.994812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c7140-9a94-4d57-9b39-8ffc6545dbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:05.017106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b98c7140-9a94-4d57-9b39-8ffc6545dbf1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:05.018255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b98c7140-9a94-4d57-9b39-8ffc6545dbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:05.026284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1146/2315] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:04 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:05.030658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1da904-fee6-4270-a69a-4f40372afa9b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:05.041524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1da904-fee6-4270-a69a-4f40372afa9b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:05.045918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ddd8b-303d-467b-863f-e340c3c9fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:05.046525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ddd8b-303d-467b-863f-e340c3c9fd3d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:05.046818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ddd8b-303d-467b-863f-e340c3c9fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:05.047104 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ddd8b-303d-467b-863f-e340c3c9fd3d admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:05.047840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ddd8b-303d-467b-863f-e340c3c9fd3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:05.048150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ddd8b-303d-467b-863f-e340c3c9fd3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:05.076297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ddd8b-303d-467b-863f-e340c3c9fd3d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:05.094636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1170/2316] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:14:05.101599 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c7140-9a94-4d57-9b39-8ffc6545dbf1 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:05.111398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c7140-9a94-4d57-9b39-8ffc6545dbf1 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:05.117394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb480e28-990d-4524-95ef-bf45a0581926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:05.118142 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb480e28-990d-4524-95ef-bf45a0581926 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:05.119091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb480e28-990d-4524-95ef-bf45a0581926 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:05.119091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb480e28-990d-4524-95ef-bf45a0581926 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:05.119967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb480e28-990d-4524-95ef-bf45a0581926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:05.148151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb480e28-990d-4524-95ef-bf45a0581926 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:05.269802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1147/2317] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:05 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:14:05.276538 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ddd8b-303d-467b-863f-e340c3c9fd3d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:05.294766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ddd8b-303d-467b-863f-e340c3c9fd3d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:05.383762 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3730df0-f5c1-4919-a0ce-e56868b5bc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:05.384361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3730df0-f5c1-4919-a0ce-e56868b5bc4d admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:05.384650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3730df0-f5c1-4919-a0ce-e56868b5bc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:05.384943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3730df0-f5c1-4919-a0ce-e56868b5bc4d admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:05.385597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3730df0-f5c1-4919-a0ce-e56868b5bc4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:05.411828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3730df0-f5c1-4919-a0ce-e56868b5bc4d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:05.539972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1171/2318] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:05 2022] POST /identity/v3/users => generated 291 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:05.546070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb480e28-990d-4524-95ef-bf45a0581926 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:05.557137 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb480e28-990d-4524-95ef-bf45a0581926 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:05.561794 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf61edd-b531-4da5-9b84-ae1e6d366633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:05.562420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61edd-b531-4da5-9b84-ae1e6d366633 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:05.562711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61edd-b531-4da5-9b84-ae1e6d366633 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:05.562997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf61edd-b531-4da5-9b84-ae1e6d366633 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:05.563764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf61edd-b531-4da5-9b84-ae1e6d366633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:05.591095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf61edd-b531-4da5-9b84-ae1e6d366633 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:05.602456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1148/2319] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:14:05.607109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3730df0-f5c1-4919-a0ce-e56868b5bc4d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:05.618138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3730df0-f5c1-4919-a0ce-e56868b5bc4d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:05.623157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ff880-eb13-49ac-b7ad-ced6a615a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:05.624067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ff880-eb13-49ac-b7ad-ced6a615a136 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:05.624360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ff880-eb13-49ac-b7ad-ced6a615a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:05.624648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ff880-eb13-49ac-b7ad-ced6a615a136 admin admin] PATH_INFO: `/v3/projects/02361b8b05cb45e59d24992064746193/users/d45edf0ccf3348a7b50daafa4f90d0f8/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:05.649718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ff880-eb13-49ac-b7ad-ced6a615a136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02361b8b05cb45e59d24992064746193, user_id=d45edf0ccf3348a7b50daafa4f90d0f8, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:05.677424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ff880-eb13-49ac-b7ad-ced6a615a136 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:05.805887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1172/2320] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:05 2022] PUT /identity/v3/projects/02361b8b05cb45e59d24992064746193/users/d45edf0ccf3348a7b50daafa4f90d0f8/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:05.816541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c1a3-d84c-45f2-9d83-f98d0b9cd713 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:05.816541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c1a3-d84c-45f2-9d83-f98d0b9cd713 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:05.816862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c1a3-d84c-45f2-9d83-f98d0b9cd713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:05.862754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ece7c1a3-d84c-45f2-9d83-f98d0b9cd713 None None] MFA Rules not processed for user `d45edf0ccf3348a7b50daafa4f90d0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:05.863957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ece7c1a3-d84c-45f2-9d83-f98d0b9cd713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:05.966442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1149/2321] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3688 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:05.970902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ff880-eb13-49ac-b7ad-ced6a615a136 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:06.047869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ff880-eb13-49ac-b7ad-ced6a615a136 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:06.061707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0051cf1-28ae-4a65-b76f-6bd629083ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:06.062782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0051cf1-28ae-4a65-b76f-6bd629083ade admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:06.063301 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0051cf1-28ae-4a65-b76f-6bd629083ade admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:06.063781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0051cf1-28ae-4a65-b76f-6bd629083ade admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:06.064609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0051cf1-28ae-4a65-b76f-6bd629083ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:06.092128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0051cf1-28ae-4a65-b76f-6bd629083ade admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:06.232194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c1a3-d84c-45f2-9d83-f98d0b9cd713 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:06.241864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1173/2322] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:05 2022] POST /identity/v3/projects => generated 381 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:06.264823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c1a3-d84c-45f2-9d83-f98d0b9cd713 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:06.413140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471f22-6fac-449f-9d47-dc0ae1c44956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:06.414262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471f22-6fac-449f-9d47-dc0ae1c44956 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:06.414830 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471f22-6fac-449f-9d47-dc0ae1c44956 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:06.415604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e471f22-6fac-449f-9d47-dc0ae1c44956 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:06.416807 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e471f22-6fac-449f-9d47-dc0ae1c44956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:06.472112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e471f22-6fac-449f-9d47-dc0ae1c44956 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:06.582565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1150/2323] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:06 2022] POST /identity/v3/users => generated 297 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:06.586943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0051cf1-28ae-4a65-b76f-6bd629083ade admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:06.597379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0051cf1-28ae-4a65-b76f-6bd629083ade admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:06.604157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bf6ed-95c8-4448-a689-79ffa2a881e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:06.604811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf6ed-95c8-4448-a689-79ffa2a881e7 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:06.605148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf6ed-95c8-4448-a689-79ffa2a881e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:06.605440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf6ed-95c8-4448-a689-79ffa2a881e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:06.606230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bf6ed-95c8-4448-a689-79ffa2a881e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:06.633652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7bf6ed-95c8-4448-a689-79ffa2a881e7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:06.647042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1174/2324] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:06.651708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471f22-6fac-449f-9d47-dc0ae1c44956 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:06.662308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e471f22-6fac-449f-9d47-dc0ae1c44956 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:06.666983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c018bb2-9d37-431a-a01c-c616f3f5221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:06.667947 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c018bb2-9d37-431a-a01c-c616f3f5221e admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:06.668239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c018bb2-9d37-431a-a01c-c616f3f5221e admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:06.668519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c018bb2-9d37-431a-a01c-c616f3f5221e admin admin] PATH_INFO: `/v3/projects/fe9098596fb34c249a8fc470d6a7498f/users/19e3058e452c4ee6bafe8a5a488508eb/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:06.690979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c018bb2-9d37-431a-a01c-c616f3f5221e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9098596fb34c249a8fc470d6a7498f, user_id=19e3058e452c4ee6bafe8a5a488508eb, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:06.719439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c018bb2-9d37-431a-a01c-c616f3f5221e admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:06.834548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1151/2325] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:06 2022] PUT /identity/v3/projects/fe9098596fb34c249a8fc470d6a7498f/users/19e3058e452c4ee6bafe8a5a488508eb/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:06.835463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bf6ed-95c8-4448-a689-79ffa2a881e7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:06.845306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bf6ed-95c8-4448-a689-79ffa2a881e7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:06.910471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118939-7abc-4c66-bc0b-202d06d70df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:06.911294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118939-7abc-4c66-bc0b-202d06d70df6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:06.911645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118939-7abc-4c66-bc0b-202d06d70df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:06.911939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3118939-7abc-4c66-bc0b-202d06d70df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:06.912641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118939-7abc-4c66-bc0b-202d06d70df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:06.941390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ddd5b-6236-4df1-a05c-338fbbc9cff3 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:06.941617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3118939-7abc-4c66-bc0b-202d06d70df6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:06.941740 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ddd5b-6236-4df1-a05c-338fbbc9cff3 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:06.942755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ddd5b-6236-4df1-a05c-338fbbc9cff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:06.955357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1175/2326] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:14:06.959772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118939-7abc-4c66-bc0b-202d06d70df6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:06.970445 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3118939-7abc-4c66-bc0b-202d06d70df6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:06.976176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab84d4-7090-4cac-b32d-c4d11e01e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:06.981629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab84d4-7090-4cac-b32d-c4d11e01e7e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:06.981629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab84d4-7090-4cac-b32d-c4d11e01e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:06.981629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab84d4-7090-4cac-b32d-c4d11e01e7e8 admin admin] PATH_INFO: `/v3/projects/fe9098596fb34c249a8fc470d6a7498f/users/19e3058e452c4ee6bafe8a5a488508eb/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:06.981629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab84d4-7090-4cac-b32d-c4d11e01e7e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9098596fb34c249a8fc470d6a7498f, user_id=19e3058e452c4ee6bafe8a5a488508eb, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:07.011280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab84d4-7090-4cac-b32d-c4d11e01e7e8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:07.034321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1176/2327] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:06 2022] PUT /identity/v3/projects/fe9098596fb34c249a8fc470d6a7498f/users/19e3058e452c4ee6bafe8a5a488508eb/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:07.038631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab84d4-7090-4cac-b32d-c4d11e01e7e8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:07.047592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f52ddd5b-6236-4df1-a05c-338fbbc9cff3 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:07.048990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f52ddd5b-6236-4df1-a05c-338fbbc9cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:07.154117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab84d4-7090-4cac-b32d-c4d11e01e7e8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:07.164265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a54d9-3e51-426a-a711-e2f62e8dc8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:07.164898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a54d9-3e51-426a-a711-e2f62e8dc8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:07.165241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a54d9-3e51-426a-a711-e2f62e8dc8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:07.165525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a54d9-3e51-426a-a711-e2f62e8dc8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:07.166234 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a54d9-3e51-426a-a711-e2f62e8dc8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:07.171492 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1152/2328] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:14:06 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:14:07.200442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a54d9-3e51-426a-a711-e2f62e8dc8d6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:07.210285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1177/2329] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:07.213742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ddd5b-6236-4df1-a05c-338fbbc9cff3 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:07.220132 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a54d9-3e51-426a-a711-e2f62e8dc8d6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:07.221769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-145a54d9-3e51-426a-a711-e2f62e8dc8d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:07.227401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ddd5b-6236-4df1-a05c-338fbbc9cff3 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:07.232056 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a2840-a60d-4219-9eba-9b4f5845e771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:07.232896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a2840-a60d-4219-9eba-9b4f5845e771 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:07.233183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a2840-a60d-4219-9eba-9b4f5845e771 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:07.233468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a2840-a60d-4219-9eba-9b4f5845e771 admin admin] PATH_INFO: `/v3/projects/fe9098596fb34c249a8fc470d6a7498f/users/19e3058e452c4ee6bafe8a5a488508eb/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:07.235628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a2840-a60d-4219-9eba-9b4f5845e771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9098596fb34c249a8fc470d6a7498f, user_id=19e3058e452c4ee6bafe8a5a488508eb, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:07.266269 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a2840-a60d-4219-9eba-9b4f5845e771 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:07.368162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1153/2330] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:07 2022] PUT /identity/v3/projects/fe9098596fb34c249a8fc470d6a7498f/users/19e3058e452c4ee6bafe8a5a488508eb/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:07.370186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a54d9-3e51-426a-a711-e2f62e8dc8d6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:07.381596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93657f3c-0e8d-42cf-bf30-acd234db68d2 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:07.381896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93657f3c-0e8d-42cf-bf30-acd234db68d2 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:07.382190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93657f3c-0e8d-42cf-bf30-acd234db68d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:07.431086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-93657f3c-0e8d-42cf-bf30-acd234db68d2 None None] MFA Rules not processed for user `19e3058e452c4ee6bafe8a5a488508eb`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:07.432996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-93657f3c-0e8d-42cf-bf30-acd234db68d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:07.466362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409997b3-318b-43b1-bef9-5d9d9394a5c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:07.467394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409997b3-318b-43b1-bef9-5d9d9394a5c4 service swift] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:07.467849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409997b3-318b-43b1-bef9-5d9d9394a5c4 service swift] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:07.468215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409997b3-318b-43b1-bef9-5d9d9394a5c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:07.566860 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409997b3-318b-43b1-bef9-5d9d9394a5c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:07.582771 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1154/2331] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:07 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:07.601213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409997b3-318b-43b1-bef9-5d9d9394a5c4 service swift] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:07.613864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1178/2332] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:14:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 18 13:14:07.651539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93657f3c-0e8d-42cf-bf30-acd234db68d2 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:07.653195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-93657f3c-0e8d-42cf-bf30-acd234db68d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:07.656300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409997b3-318b-43b1-bef9-5d9d9394a5c4 service swift] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:07.657817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-409997b3-318b-43b1-bef9-5d9d9394a5c4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:07.747971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409997b3-318b-43b1-bef9-5d9d9394a5c4 service swift] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:07.752332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2be5a-7d7f-407d-9ac5-fb88811991f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:07.753263 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2be5a-7d7f-407d-9ac5-fb88811991f6 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:07.753455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2be5a-7d7f-407d-9ac5-fb88811991f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:07.754000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2be5a-7d7f-407d-9ac5-fb88811991f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:07.762425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93657f3c-0e8d-42cf-bf30-acd234db68d2 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:07.764074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2be5a-7d7f-407d-9ac5-fb88811991f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:07.767327 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:07.768235 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:07.768537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:07.768824 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] PATH_INFO: `/v3/users/1b1eb45ea9874a97acc979858a229e5a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:07.769994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1eb45ea9874a97acc979858a229e5a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:07.792861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f2be5a-7d7f-407d-9ac5-fb88811991f6 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:07.803552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1179/2333] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:07 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:07.804217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:08.051215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1eb45ea9874a97acc979858a229e5a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:08.074784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1eb45ea9874a97acc979858a229e5a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:08.075751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1eb45ea9874a97acc979858a229e5a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:08.091479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1eb45ea9874a97acc979858a229e5a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:08.184859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1eb45ea9874a97acc979858a229e5a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:08.194335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1155/2334] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:07 2022] DELETE /identity/v3/users/1b1eb45ea9874a97acc979858a229e5a => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:08.203002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ace616-54c4-415c-b2b9-5da9c051281e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:08.203574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ace616-54c4-415c-b2b9-5da9c051281e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:08.204600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ace616-54c4-415c-b2b9-5da9c051281e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:08.227778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-07ace616-54c4-415c-b2b9-5da9c051281e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:08.229098 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-07ace616-54c4-415c-b2b9-5da9c051281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:08.307160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1180/2335] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:08.323073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:08.325397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:08.416135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4604951e-9945-4389-9822-f4a21caf6286 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:08.421581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab9fa-9cf6-4580-924b-b23f1c08919a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:08.422426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab9fa-9cf6-4580-924b-b23f1c08919a service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:08.422818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab9fa-9cf6-4580-924b-b23f1c08919a service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:08.423207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ab9fa-9cf6-4580-924b-b23f1c08919a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:08.440202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ab9fa-9cf6-4580-924b-b23f1c08919a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:08.472353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ab9fa-9cf6-4580-924b-b23f1c08919a service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:08.485777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1156/2336] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:09.310676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ace616-54c4-415c-b2b9-5da9c051281e None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:09.312608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-07ace616-54c4-415c-b2b9-5da9c051281e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:09.407285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ace616-54c4-415c-b2b9-5da9c051281e None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:09.413333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab9fa-9cf6-4580-924b-b23f1c08919a service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:09.414841 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-371ab9fa-9cf6-4580-924b-b23f1c08919a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:09.418609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06995b-fbff-4239-8c0e-41b1b6ae729a tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e3058e452c4ee6bafe8a5a488508eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe9098596fb34c249a8fc470d6a7498f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:09.419324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06995b-fbff-4239-8c0e-41b1b6ae729a tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:09.420361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06995b-fbff-4239-8c0e-41b1b6ae729a tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:09.420659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06995b-fbff-4239-8c0e-41b1b6ae729a tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:09.421429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06995b-fbff-4239-8c0e-41b1b6ae729a tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:09.421742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06995b-fbff-4239-8c0e-41b1b6ae729a tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:09.444635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ab9fa-9cf6-4580-924b-b23f1c08919a service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:09.452590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06995b-fbff-4239-8c0e-41b1b6ae729a tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:09.457058 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:09.458696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:09.461737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:09.465978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] PATH_INFO: `/v3/projects/1b1c286b84ed47eaaec86b88af7c5628` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:09.465978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1c286b84ed47eaaec86b88af7c5628)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:09.468282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1181/2337] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:14:09.472378 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06995b-fbff-4239-8c0e-41b1b6ae729a tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:09.493980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:09.500056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06995b-fbff-4239-8c0e-41b1b6ae729a tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:09.500926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9539-8850-4813-bc29-61f62b0bedd2 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e3058e452c4ee6bafe8a5a488508eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe9098596fb34c249a8fc470d6a7498f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:09.501853 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9539-8850-4813-bc29-61f62b0bedd2 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:09.502251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9539-8850-4813-bc29-61f62b0bedd2 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:09.502609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9539-8850-4813-bc29-61f62b0bedd2 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:09.503412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a9539-8850-4813-bc29-61f62b0bedd2 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:09.532620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a9539-8850-4813-bc29-61f62b0bedd2 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:09.676126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1182/2338] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:09 2022] POST /identity/v3/projects => generated 355 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:14:09.681358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9539-8850-4813-bc29-61f62b0bedd2 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:09.700873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1c286b84ed47eaaec86b88af7c5628', 'request_id': 'req-dd0c9819-78e9-441d-b636-9393c54e8e23'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:09.790463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1c286b84ed47eaaec86b88af7c5628', 'request_id': 'req-dd0c9819-78e9-441d-b636-9393c54e8e23'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:09.807972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9539-8850-4813-bc29-61f62b0bedd2 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:09.813596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1c286b84ed47eaaec86b88af7c5628', 'request_id': 'req-dd0c9819-78e9-441d-b636-9393c54e8e23'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:09.832695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e3058e452c4ee6bafe8a5a488508eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe9098596fb34c249a8fc470d6a7498f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:09.837310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:09.837837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:09.839162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:09.841382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:09.841952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:09.860266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] The token cache is being invalidate because project 1b1c286b84ed47eaaec86b88af7c5628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:09.860780 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:09.872184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:09.879613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1157/2339] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:09 2022] DELETE /identity/v3/projects/1b1c286b84ed47eaaec86b88af7c5628 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:09.882552 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:09.883987 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:09.922814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:09.957316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1183/2340] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:14:10.042857 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9819-78e9-441d-b636-9393c54e8e23 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:10.078585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:10.080812 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:10.104228 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45911812-f623-4cce-9803-31c1360f2dd0 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:10.110632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19e3058e452c4ee6bafe8a5a488508eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe9098596fb34c249a8fc470d6a7498f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:10.111639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:10.112018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:10.112360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] PATH_INFO: `/v3/projects/2596217b7c164dd2b0bb19e8dc0c6f7f` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:10.113727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2596217b7c164dd2b0bb19e8dc0c6f7f)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:10.154818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:10.269564 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:10.271362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:10.271781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:10.272124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] PATH_INFO: `/v3/users/812998a1dffb406dab1b142a8844742d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:10.273648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=812998a1dffb406dab1b142a8844742d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:10.299719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2596217b7c164dd2b0bb19e8dc0c6f7f', 'request_id': 'req-546c6100-d49a-494c-8432-d12b18932d33'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.330915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:10.433463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2596217b7c164dd2b0bb19e8dc0c6f7f', 'request_id': 'req-546c6100-d49a-494c-8432-d12b18932d33'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.453828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2596217b7c164dd2b0bb19e8dc0c6f7f', 'request_id': 'req-546c6100-d49a-494c-8432-d12b18932d33'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.475960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] The token cache is being invalidate because project 2596217b7c164dd2b0bb19e8dc0c6f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:10.476190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.476910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.480226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1184/2341] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:10 2022] DELETE /identity/v3/projects/2596217b7c164dd2b0bb19e8dc0c6f7f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:10.585491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '812998a1dffb406dab1b142a8844742d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.606764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '812998a1dffb406dab1b142a8844742d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.607516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '812998a1dffb406dab1b142a8844742d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.616516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '812998a1dffb406dab1b142a8844742d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.791158 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '812998a1dffb406dab1b142a8844742d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:10.803970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1158/2342] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:09 2022] DELETE /identity/v3/users/812998a1dffb406dab1b142a8844742d => generated 0 bytes in 917 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:11.477013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:11.484405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:11.539196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:11.541474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:11.623747 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c6100-d49a-494c-8432-d12b18932d33 tempest-VolumeQuotaClassesTest-1215326753 tempest-VolumeQuotaClassesTest-1215326753-project-admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:11.681165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a6df7-e780-45ab-ac74-a9c28bff6e2a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:11.702330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:11.703167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:11.703506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:11.703792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] PATH_INFO: `/v3/users/d45edf0ccf3348a7b50daafa4f90d0f8` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:11.705180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45edf0ccf3348a7b50daafa4f90d0f8)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:11.735483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:11.770589 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:11.775333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:11.775333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:11.775333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] PATH_INFO: `/v3/projects/6cf05dc5a7d14dcf9772a86e46aa5273` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:11.775333 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf05dc5a7d14dcf9772a86e46aa5273)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:11.803689 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:12.026626 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45edf0ccf3348a7b50daafa4f90d0f8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.041007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf05dc5a7d14dcf9772a86e46aa5273', 'request_id': 'req-54504630-11b9-4b1c-887b-efbeef029b6c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.049278 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45edf0ccf3348a7b50daafa4f90d0f8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.050062 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45edf0ccf3348a7b50daafa4f90d0f8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.061819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45edf0ccf3348a7b50daafa4f90d0f8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.153214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf05dc5a7d14dcf9772a86e46aa5273', 'request_id': 'req-54504630-11b9-4b1c-887b-efbeef029b6c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.170682 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf05dc5a7d14dcf9772a86e46aa5273', 'request_id': 'req-54504630-11b9-4b1c-887b-efbeef029b6c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.198654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] The token cache is being invalidate because project 6cf05dc5a7d14dcf9772a86e46aa5273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:12.198957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.199699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.201529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1185/2343] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:11 2022] DELETE /identity/v3/projects/6cf05dc5a7d14dcf9772a86e46aa5273 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:12.210637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:12.213387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:12.227140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b014f0b-b207-4692-946c-48f194d6b6fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45edf0ccf3348a7b50daafa4f90d0f8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.237375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1159/2344] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:11 2022] DELETE /identity/v3/users/d45edf0ccf3348a7b50daafa4f90d0f8 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:12.245200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681cc84-6454-4e03-8bc4-60f9e1ccb987 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:12.245732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681cc84-6454-4e03-8bc4-60f9e1ccb987 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:12.245732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681cc84-6454-4e03-8bc4-60f9e1ccb987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:12.298600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-3681cc84-6454-4e03-8bc4-60f9e1ccb987 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:12.302345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-3681cc84-6454-4e03-8bc4-60f9e1ccb987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:12.335674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54504630-11b9-4b1c-887b-efbeef029b6c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:12.392547 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1160/2345] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:12.409702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681cc84-6454-4e03-8bc4-60f9e1ccb987 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:12.412281 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-3681cc84-6454-4e03-8bc4-60f9e1ccb987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:12.418406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:12.419928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:12.420231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:12.420715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] PATH_INFO: `/v3/users/e287c66e4be44455b38d8af655a15e52` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:12.422251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e287c66e4be44455b38d8af655a15e52)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:12.460838 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:12.514844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681cc84-6454-4e03-8bc4-60f9e1ccb987 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:12.518894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c1d22-7e70-4718-ad68-3d7309064021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:12.519690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1d22-7e70-4718-ad68-3d7309064021 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:12.520702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1d22-7e70-4718-ad68-3d7309064021 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:12.521468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c1d22-7e70-4718-ad68-3d7309064021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:12.532208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c1d22-7e70-4718-ad68-3d7309064021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:12.558063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c1d22-7e70-4718-ad68-3d7309064021 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:12.573171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1161/2346] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:12 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:12.711557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e287c66e4be44455b38d8af655a15e52'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.713559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e287c66e4be44455b38d8af655a15e52'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.730816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e287c66e4be44455b38d8af655a15e52'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.763338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e287c66e4be44455b38d8af655a15e52'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.896780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e287c66e4be44455b38d8af655a15e52'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:12.904918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1186/2347] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:12 2022] DELETE /identity/v3/users/e287c66e4be44455b38d8af655a15e52 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:13.729180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c1d22-7e70-4718-ad68-3d7309064021 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:13.732580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-878c1d22-7e70-4718-ad68-3d7309064021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:13.768019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c1d22-7e70-4718-ad68-3d7309064021 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:13.867883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:13.868984 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:13.869676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:13.870117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] PATH_INFO: `/v3/projects/02361b8b05cb45e59d24992064746193` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:13.871494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02361b8b05cb45e59d24992064746193)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:13.912688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:13.914678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:13.931041 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3874cb-b734-46ce-8ce0-63459dc82b1f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:13.936500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:13.940603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:13.940883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:13.941166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] PATH_INFO: `/v3/projects/48e6ec4f9a314efd872b0597e9d858de` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:13.943350 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e6ec4f9a314efd872b0597e9d858de)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:13.947054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:13.971779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:14.122295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e6ec4f9a314efd872b0597e9d858de', 'request_id': 'req-86f89602-dc33-4f1d-8162-4c4dc6bf4425'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.133446 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02361b8b05cb45e59d24992064746193', 'request_id': 'req-a9fff791-d94c-412b-af10-903f57ec4534'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.235952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e6ec4f9a314efd872b0597e9d858de', 'request_id': 'req-86f89602-dc33-4f1d-8162-4c4dc6bf4425'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.251661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e6ec4f9a314efd872b0597e9d858de', 'request_id': 'req-86f89602-dc33-4f1d-8162-4c4dc6bf4425'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.273837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] The token cache is being invalidate because project 48e6ec4f9a314efd872b0597e9d858de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:14.274593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.278699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-86f89602-dc33-4f1d-8162-4c4dc6bf4425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.285032 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1187/2348] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:13 2022] DELETE /identity/v3/projects/48e6ec4f9a314efd872b0597e9d858de => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:14.286150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96ab9-45ce-469f-b87a-9e16ebbbfba0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:14.286545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96ab9-45ce-469f-b87a-9e16ebbbfba0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:14.286914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e96ab9-45ce-469f-b87a-9e16ebbbfba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:14.320574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e3e96ab9-45ce-469f-b87a-9e16ebbbfba0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:14.322651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e3e96ab9-45ce-469f-b87a-9e16ebbbfba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:14.331030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02361b8b05cb45e59d24992064746193', 'request_id': 'req-a9fff791-d94c-412b-af10-903f57ec4534'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.362224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02361b8b05cb45e59d24992064746193', 'request_id': 'req-a9fff791-d94c-412b-af10-903f57ec4534'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.414326 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] The token cache is being invalidate because project 02361b8b05cb45e59d24992064746193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:14.414965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.417590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:14.422823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1162/2349] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:13 2022] DELETE /identity/v3/projects/02361b8b05cb45e59d24992064746193 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:14.428418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:14.432670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:14.478713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1188/2350] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:14.487251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a42e7-1164-42fa-bfa5-d1aeb7a00a05 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:14.488231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a42e7-1164-42fa-bfa5-d1aeb7a00a05 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:14.489280 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6a42e7-1164-42fa-bfa5-d1aeb7a00a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:14.523603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-fb6a42e7-1164-42fa-bfa5-d1aeb7a00a05 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:14.530316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-fb6a42e7-1164-42fa-bfa5-d1aeb7a00a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:14.541492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1189/2351] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:14.545888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a42e7-1164-42fa-bfa5-d1aeb7a00a05 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:14.558208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6a42e7-1164-42fa-bfa5-d1aeb7a00a05 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:14.572040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b8a0-82ef-41d8-86ba-65e587bf1b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:14.572797 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b8a0-82ef-41d8-86ba-65e587bf1b7b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:14.573157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b8a0-82ef-41d8-86ba-65e587bf1b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:14.573506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b8a0-82ef-41d8-86ba-65e587bf1b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:14.574367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b8a0-82ef-41d8-86ba-65e587bf1b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:14.574743 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b8a0-82ef-41d8-86ba-65e587bf1b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:14.606381 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fff791-d94c-412b-af10-903f57ec4534 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:14.606381 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:14.606813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:14.607172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:14.607580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] PATH_INFO: `/v3/users/19e3058e452c4ee6bafe8a5a488508eb` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:14.609310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e3058e452c4ee6bafe8a5a488508eb)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:14.637536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:14.647612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b8a0-82ef-41d8-86ba-65e587bf1b7b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:14.689861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1190/2352] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:14:14.692118 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b8a0-82ef-41d8-86ba-65e587bf1b7b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:14.715156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b8a0-82ef-41d8-86ba-65e587bf1b7b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:14.724615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5236f7-71fb-4904-9753-b11e157ba947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:14.730091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5236f7-71fb-4904-9753-b11e157ba947 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:14.730309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5236f7-71fb-4904-9753-b11e157ba947 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:14.730603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5236f7-71fb-4904-9753-b11e157ba947 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:14.731637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5236f7-71fb-4904-9753-b11e157ba947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:14.780492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5236f7-71fb-4904-9753-b11e157ba947 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:14.968002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1191/2353] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:14 2022] POST /identity/v3/projects => generated 375 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:14.970243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5236f7-71fb-4904-9753-b11e157ba947 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:15.060706 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e3058e452c4ee6bafe8a5a488508eb'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:15.096596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e3058e452c4ee6bafe8a5a488508eb'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:15.098891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e3058e452c4ee6bafe8a5a488508eb'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:15.119988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e3058e452c4ee6bafe8a5a488508eb'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:15.152604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5236f7-71fb-4904-9753-b11e157ba947 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:15.157529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8dff6-5a96-4966-8e61-f9192f8e1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:15.158144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8dff6-5a96-4966-8e61-f9192f8e1dbc admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:15.158480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8dff6-5a96-4966-8e61-f9192f8e1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:15.158721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8dff6-5a96-4966-8e61-f9192f8e1dbc admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:15.159402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8dff6-5a96-4966-8e61-f9192f8e1dbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:15.193301 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8dff6-5a96-4966-8e61-f9192f8e1dbc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:15.198317 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e3058e452c4ee6bafe8a5a488508eb'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:15.210143 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1163/2354] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:14 2022] DELETE /identity/v3/users/19e3058e452c4ee6bafe8a5a488508eb => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:15.317652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1192/2355] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:14 2022] POST /identity/v3/users => generated 288 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:15.319298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:15.320975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:15.429698 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d867e-6578-4aa3-90f8-389d05e49998 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:15.435539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e7060-3ca8-4939-a35f-9c0d060833e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:15.436150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7060-3ca8-4939-a35f-9c0d060833e9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:15.436436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7060-3ca8-4939-a35f-9c0d060833e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:15.436711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e7060-3ca8-4939-a35f-9c0d060833e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:15.437750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e7060-3ca8-4939-a35f-9c0d060833e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:15.466101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e7060-3ca8-4939-a35f-9c0d060833e9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:15.477112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1164/2356] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:15.482250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8dff6-5a96-4966-8e61-f9192f8e1dbc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:15.492188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8dff6-5a96-4966-8e61-f9192f8e1dbc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:15.496617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15f77d-1fa4-45db-8cc9-f5f664b2dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:15.497440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15f77d-1fa4-45db-8cc9-f5f664b2dbee admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:15.497746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15f77d-1fa4-45db-8cc9-f5f664b2dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:15.498102 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15f77d-1fa4-45db-8cc9-f5f664b2dbee admin admin] PATH_INFO: `/v3/projects/29adb943d7e44e99a789026b518082bf/users/06f95f6d30c24a62890200a4ed5ae1d4/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:15.521212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15f77d-1fa4-45db-8cc9-f5f664b2dbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=29adb943d7e44e99a789026b518082bf, user_id=06f95f6d30c24a62890200a4ed5ae1d4, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:15.553477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15f77d-1fa4-45db-8cc9-f5f664b2dbee admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:15.706067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1193/2357] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:15 2022] PUT /identity/v3/projects/29adb943d7e44e99a789026b518082bf/users/06f95f6d30c24a62890200a4ed5ae1d4/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:15.717714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbea4e-d877-44a3-bcc8-116826ac40d7 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:15.718012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbea4e-d877-44a3-bcc8-116826ac40d7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:15.718297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbea4e-d877-44a3-bcc8-116826ac40d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:15.857122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-53fbea4e-d877-44a3-bcc8-116826ac40d7 None None] MFA Rules not processed for user `06f95f6d30c24a62890200a4ed5ae1d4`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:15.858167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-53fbea4e-d877-44a3-bcc8-116826ac40d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:16.078791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15f77d-1fa4-45db-8cc9-f5f664b2dbee admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:16.089155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-dc15f77d-1fa4-45db-8cc9-f5f664b2dbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:16.168951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15f77d-1fa4-45db-8cc9-f5f664b2dbee admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:16.176682 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:16.177737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:16.178208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:16.181676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1165/2358] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:15 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:16.184899 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] PATH_INFO: `/v3/projects/fe9098596fb34c249a8fc470d6a7498f` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:16.187718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9098596fb34c249a8fc470d6a7498f)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:16.188844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbea4e-d877-44a3-bcc8-116826ac40d7 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:16.190346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-53fbea4e-d877-44a3-bcc8-116826ac40d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:16.221244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:16.320170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbea4e-d877-44a3-bcc8-116826ac40d7 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:16.329598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81a813-af0b-49f4-b73f-febb398af00d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:16.329598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a813-af0b-49f4-b73f-febb398af00d service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:16.329598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a813-af0b-49f4-b73f-febb398af00d service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:16.329598 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81a813-af0b-49f4-b73f-febb398af00d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:16.352756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81a813-af0b-49f4-b73f-febb398af00d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:16.406848 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9098596fb34c249a8fc470d6a7498f', 'request_id': 'req-15352b2a-09ee-4a52-be4d-7beeb65d89c2'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:16.422430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81a813-af0b-49f4-b73f-febb398af00d service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:16.437289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1166/2359] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:16 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:16.438580 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18628b44-b672-48ba-a1ca-ded3684b2146 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:16.438874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18628b44-b672-48ba-a1ca-ded3684b2146 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:16.439214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18628b44-b672-48ba-a1ca-ded3684b2146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:16.474108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-18628b44-b672-48ba-a1ca-ded3684b2146 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:16.475530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-18628b44-b672-48ba-a1ca-ded3684b2146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:16.517621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9098596fb34c249a8fc470d6a7498f', 'request_id': 'req-15352b2a-09ee-4a52-be4d-7beeb65d89c2'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:16.548108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9098596fb34c249a8fc470d6a7498f', 'request_id': 'req-15352b2a-09ee-4a52-be4d-7beeb65d89c2'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:16.579734 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] The token cache is being invalidate because project fe9098596fb34c249a8fc470d6a7498f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:16.580053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:16.587941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-15352b2a-09ee-4a52-be4d-7beeb65d89c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:16.587941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1194/2360] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:16 2022] DELETE /identity/v3/projects/fe9098596fb34c249a8fc470d6a7498f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:16.589894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d3ea7-77d6-4951-bc05-f77d4d13cbd3 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:16.590362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d3ea7-77d6-4951-bc05-f77d4d13cbd3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:16.590796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d3ea7-77d6-4951-bc05-f77d4d13cbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:16.594873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1167/2361] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:16.613339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18628b44-b672-48ba-a1ca-ded3684b2146 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:16.615965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-18628b44-b672-48ba-a1ca-ded3684b2146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:16.632603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d31d3ea7-77d6-4951-bc05-f77d4d13cbd3 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:16.633900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d31d3ea7-77d6-4951-bc05-f77d4d13cbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:16.754155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18628b44-b672-48ba-a1ca-ded3684b2146 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:16.762762 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1195/2362] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:16.762953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280505-09bf-4453-ad61-8bad6778c57b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:16.762953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280505-09bf-4453-ad61-8bad6778c57b service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:16.762953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280505-09bf-4453-ad61-8bad6778c57b service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:16.762953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280505-09bf-4453-ad61-8bad6778c57b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:16.765377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963029f5-c566-4d2c-9bda-f3c9a3baa749 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:16.765688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963029f5-c566-4d2c-9bda-f3c9a3baa749 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:16.765978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963029f5-c566-4d2c-9bda-f3c9a3baa749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:16.770620 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6280505-09bf-4453-ad61-8bad6778c57b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:16.800819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-963029f5-c566-4d2c-9bda-f3c9a3baa749 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:16.801741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6280505-09bf-4453-ad61-8bad6778c57b service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:16.803327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-963029f5-c566-4d2c-9bda-f3c9a3baa749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:16.811850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1168/2363] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:14:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 18 13:14:16.813158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1196/2364] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:16.817707 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280505-09bf-4453-ad61-8bad6778c57b service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:16.829275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280505-09bf-4453-ad61-8bad6778c57b service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:16.838717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921f2b4-d1c2-4a46-9ac4-a0af71917056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:16.838717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921f2b4-d1c2-4a46-9ac4-a0af71917056 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:16.838717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921f2b4-d1c2-4a46-9ac4-a0af71917056 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:16.838717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921f2b4-d1c2-4a46-9ac4-a0af71917056 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:16.839218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921f2b4-d1c2-4a46-9ac4-a0af71917056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:16.839218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921f2b4-d1c2-4a46-9ac4-a0af71917056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:16.865174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921f2b4-d1c2-4a46-9ac4-a0af71917056 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:16.885899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1169/2365] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:14:16.886889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963029f5-c566-4d2c-9bda-f3c9a3baa749 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:16.898116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963029f5-c566-4d2c-9bda-f3c9a3baa749 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:16.907592 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0d5e0-a018-4567-a85e-80506d40e634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:16.908293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0d5e0-a018-4567-a85e-80506d40e634 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:16.908787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0d5e0-a018-4567-a85e-80506d40e634 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:16.909148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0d5e0-a018-4567-a85e-80506d40e634 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:16.909966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0d5e0-a018-4567-a85e-80506d40e634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:16.938430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0d5e0-a018-4567-a85e-80506d40e634 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:17.082235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1197/2366] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:16 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:17.088059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921f2b4-d1c2-4a46-9ac4-a0af71917056 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:17.100609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921f2b4-d1c2-4a46-9ac4-a0af71917056 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:17.301846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2fa26-c082-4a4f-bab1-e440a6836055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:17.302778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2fa26-c082-4a4f-bab1-e440a6836055 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:17.303743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2fa26-c082-4a4f-bab1-e440a6836055 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:17.304037 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2fa26-c082-4a4f-bab1-e440a6836055 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:17.305189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2fa26-c082-4a4f-bab1-e440a6836055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:17.338708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2fa26-c082-4a4f-bab1-e440a6836055 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:17.486017 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1170/2367] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:17 2022] POST /identity/v3/users => generated 293 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:17.499781 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0d5e0-a018-4567-a85e-80506d40e634 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:17.506892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0d5e0-a018-4567-a85e-80506d40e634 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:17.519848 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27925465-bcb1-44ae-9530-dde77390d70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:17.520614 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27925465-bcb1-44ae-9530-dde77390d70d admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:17.520908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27925465-bcb1-44ae-9530-dde77390d70d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:17.521206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27925465-bcb1-44ae-9530-dde77390d70d admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:17.521905 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27925465-bcb1-44ae-9530-dde77390d70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:17.565328 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27925465-bcb1-44ae-9530-dde77390d70d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:17.580756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1198/2368] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:17.582194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2fa26-c082-4a4f-bab1-e440a6836055 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:17.597676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2fa26-c082-4a4f-bab1-e440a6836055 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:17.610191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8fb2a-8801-46f1-bbbb-24ce1583f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:17.610191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8fb2a-8801-46f1-bbbb-24ce1583f1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:17.610191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8fb2a-8801-46f1-bbbb-24ce1583f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:17.618529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8fb2a-8801-46f1-bbbb-24ce1583f1a3 admin admin] PATH_INFO: `/v3/projects/929cc7a635d143cead0816a80c11e3a9/users/5a747e28b05448ba83a4596457bb9b9d/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:17.661830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27925465-bcb1-44ae-9530-dde77390d70d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:17.663668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-27925465-bcb1-44ae-9530-dde77390d70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:17.683284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8fb2a-8801-46f1-bbbb-24ce1583f1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=929cc7a635d143cead0816a80c11e3a9, user_id=5a747e28b05448ba83a4596457bb9b9d, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:17.689465 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27925465-bcb1-44ae-9530-dde77390d70d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:17.703297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:17.705508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:17.707944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:17.708276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] PATH_INFO: `/v3/users/2aabadeb65414e27b50b34f08e132392` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:17.710615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aabadeb65414e27b50b34f08e132392)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:17.739137 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8fb2a-8801-46f1-bbbb-24ce1583f1a3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:17.781179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:17.888090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1171/2369] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:17 2022] PUT /identity/v3/projects/929cc7a635d143cead0816a80c11e3a9/users/5a747e28b05448ba83a4596457bb9b9d/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:17.899741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdebc2f-fd27-4920-b4b0-1a0d55cac5e4 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:17.900545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdebc2f-fd27-4920-b4b0-1a0d55cac5e4 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:17.900846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdebc2f-fd27-4920-b4b0-1a0d55cac5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:17.982358 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-dfdebc2f-fd27-4920-b4b0-1a0d55cac5e4 None None] MFA Rules not processed for user `5a747e28b05448ba83a4596457bb9b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:17.983711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dfdebc2f-fd27-4920-b4b0-1a0d55cac5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:18.111834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aabadeb65414e27b50b34f08e132392'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:18.112514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aabadeb65414e27b50b34f08e132392'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:18.139838 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aabadeb65414e27b50b34f08e132392'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:18.170431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aabadeb65414e27b50b34f08e132392'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:18.242673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1172/2370] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:17 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:14:18.244187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdebc2f-fd27-4920-b4b0-1a0d55cac5e4 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:18.272902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-5438baa4-acbc-47c0-a132-4b19a12bbb64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aabadeb65414e27b50b34f08e132392'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:18.283796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1199/2371] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:17 2022] DELETE /identity/v3/users/2aabadeb65414e27b50b34f08e132392 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:18.290585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898d459-9dba-4627-b358-2c3040d4865f None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:18.291004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898d459-9dba-4627-b358-2c3040d4865f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:18.291400 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898d459-9dba-4627-b358-2c3040d4865f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:18.365623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f898d459-9dba-4627-b358-2c3040d4865f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:18.367254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f898d459-9dba-4627-b358-2c3040d4865f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:18.438509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdebc2f-fd27-4920-b4b0-1a0d55cac5e4 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:18.453727 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1200/2372] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:18.458425 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e099-a0ff-490c-8c66-4554524b577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:18.459116 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e099-a0ff-490c-8c66-4554524b577a admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:18.459426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e099-a0ff-490c-8c66-4554524b577a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:18.459710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c9e099-a0ff-490c-8c66-4554524b577a admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:18.460443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e099-a0ff-490c-8c66-4554524b577a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:18.468830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898d459-9dba-4627-b358-2c3040d4865f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:18.472327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f898d459-9dba-4627-b358-2c3040d4865f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:18.546049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c9e099-a0ff-490c-8c66-4554524b577a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:18.660535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898d459-9dba-4627-b358-2c3040d4865f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:18.671545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32032b0-8244-4927-afbd-64b4b7b70c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:18.672460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32032b0-8244-4927-afbd-64b4b7b70c04 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:18.672755 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32032b0-8244-4927-afbd-64b4b7b70c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:18.673037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32032b0-8244-4927-afbd-64b4b7b70c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:18.702912 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32032b0-8244-4927-afbd-64b4b7b70c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:18.730708 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1173/2373] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:18 2022] POST /identity/v3/projects => generated 389 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:18.732342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e099-a0ff-490c-8c66-4554524b577a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:18.734182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-37c9e099-a0ff-490c-8c66-4554524b577a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:18.770852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32032b0-8244-4927-afbd-64b4b7b70c04 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:18.809600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1201/2374] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:18 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:18.881621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c9e099-a0ff-490c-8c66-4554524b577a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:18.901182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02059a-fa66-46c1-9131-6d3f7c7049f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:18.901853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02059a-fa66-46c1-9131-6d3f7c7049f7 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:18.902176 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02059a-fa66-46c1-9131-6d3f7c7049f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:18.902594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02059a-fa66-46c1-9131-6d3f7c7049f7 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:18.903382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02059a-fa66-46c1-9131-6d3f7c7049f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:18.956477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02059a-fa66-46c1-9131-6d3f7c7049f7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:19.099461 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1174/2375] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:18 2022] POST /identity/v3/users => generated 301 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:14:19.100990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32032b0-8244-4927-afbd-64b4b7b70c04 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:19.118680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32032b0-8244-4927-afbd-64b4b7b70c04 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:19.137576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19079fb0-046f-4121-b633-19abe92eb9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:19.139531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19079fb0-046f-4121-b633-19abe92eb9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:19.139990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19079fb0-046f-4121-b633-19abe92eb9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:19.140424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19079fb0-046f-4121-b633-19abe92eb9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:19.141284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19079fb0-046f-4121-b633-19abe92eb9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:19.242424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19079fb0-046f-4121-b633-19abe92eb9f3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:19.286506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1202/2376] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:19.287761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02059a-fa66-46c1-9131-6d3f7c7049f7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:19.307787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02059a-fa66-46c1-9131-6d3f7c7049f7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:19.335833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d087f-4652-43c4-92b2-dae8e913ad85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:19.337021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d087f-4652-43c4-92b2-dae8e913ad85 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:19.337463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d087f-4652-43c4-92b2-dae8e913ad85 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:19.337924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d087f-4652-43c4-92b2-dae8e913ad85 admin admin] PATH_INFO: `/v3/projects/6ce3b4f48516448ab3243a6250791274/users/3e433455a4a64101813429e411f8c0ca/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:19.402605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d087f-4652-43c4-92b2-dae8e913ad85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce3b4f48516448ab3243a6250791274, user_id=3e433455a4a64101813429e411f8c0ca, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:19.481878 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d087f-4652-43c4-92b2-dae8e913ad85 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:19.682861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1175/2377] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:19 2022] PUT /identity/v3/projects/6ce3b4f48516448ab3243a6250791274/users/3e433455a4a64101813429e411f8c0ca/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:19.721073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19079fb0-046f-4121-b633-19abe92eb9f3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:19.760306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19079fb0-046f-4121-b633-19abe92eb9f3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:20.045057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32346597-35fc-4b76-9308-c9b5acc58387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:20.045674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32346597-35fc-4b76-9308-c9b5acc58387 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:20.045970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32346597-35fc-4b76-9308-c9b5acc58387 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:20.046253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32346597-35fc-4b76-9308-c9b5acc58387 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:20.046957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32346597-35fc-4b76-9308-c9b5acc58387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:20.059474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d087f-4652-43c4-92b2-dae8e913ad85 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:20.063994 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-150d087f-4652-43c4-92b2-dae8e913ad85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:20.085214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32346597-35fc-4b76-9308-c9b5acc58387 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:20.088574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d087f-4652-43c4-92b2-dae8e913ad85 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:20.097777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1203/2378] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:20.104373 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32346597-35fc-4b76-9308-c9b5acc58387 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:20.107194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-32346597-35fc-4b76-9308-c9b5acc58387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:20.117405 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:20.118429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:20.121511 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:20.123714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32346597-35fc-4b76-9308-c9b5acc58387 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:20.125582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] PATH_INFO: `/v3/projects/5e6b35bd95ce4f4585d698485d4231ce` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:20.128349 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6b35bd95ce4f4585d698485d4231ce)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:20.152169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:20.153306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:20.154025 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:20.154887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] PATH_INFO: `/v3/users/3e0b5da75f12486bb2e5c656161972c3` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:20.156654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0b5da75f12486bb2e5c656161972c3)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:20.204595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:20.228957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:20.518673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0b5da75f12486bb2e5c656161972c3'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:20.519878 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0b5da75f12486bb2e5c656161972c3'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:20.539139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6b35bd95ce4f4585d698485d4231ce', 'request_id': 'req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:20.543037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0b5da75f12486bb2e5c656161972c3'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:20.575705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0b5da75f12486bb2e5c656161972c3'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:20.663550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6b35bd95ce4f4585d698485d4231ce', 'request_id': 'req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:20.695985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6b35bd95ce4f4585d698485d4231ce', 'request_id': 'req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:20.733415 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] The token cache is being invalidate because project 5e6b35bd95ce4f4585d698485d4231ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:20.733645 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:20.735355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:20.745735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1176/2379] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:20 2022] DELETE /identity/v3/projects/5e6b35bd95ce4f4585d698485d4231ce => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:20.745735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:20.750729 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:20.897165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c87e-5ed0-43c7-83d7-3eec0b1f68b0 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:20.916574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ea880-9d82-4e0d-a9fb-dd4f58a78890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:20.917794 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea880-9d82-4e0d-a9fb-dd4f58a78890 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:20.918184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea880-9d82-4e0d-a9fb-dd4f58a78890 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:20.921988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea880-9d82-4e0d-a9fb-dd4f58a78890 admin admin] PATH_INFO: `/v3/projects/6ce3b4f48516448ab3243a6250791274/users/3e433455a4a64101813429e411f8c0ca/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:20.925859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ea880-9d82-4e0d-a9fb-dd4f58a78890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce3b4f48516448ab3243a6250791274, user_id=3e433455a4a64101813429e411f8c0ca, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:20.974746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ea880-9d82-4e0d-a9fb-dd4f58a78890 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:20.992890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1177/2380] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:20 2022] PUT /identity/v3/projects/6ce3b4f48516448ab3243a6250791274/users/3e433455a4a64101813429e411f8c0ca/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:20.994241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47222c71-e3d2-4d07-9434-d81a411d1504 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:20.994538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47222c71-e3d2-4d07-9434-d81a411d1504 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:20.994816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47222c71-e3d2-4d07-9434-d81a411d1504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:21.043230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-47222c71-e3d2-4d07-9434-d81a411d1504 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:21.049799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0b5da75f12486bb2e5c656161972c3'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:21.059983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-47222c71-e3d2-4d07-9434-d81a411d1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:21.060838 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1204/2381] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:20 2022] DELETE /identity/v3/users/3e0b5da75f12486bb2e5c656161972c3 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:21.061795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:21.066156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:21.253877 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1178/2382] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:21.256080 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab8d2e-4952-4e6a-b5a5-a8ff8afe5d59 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:21.256560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab8d2e-4952-4e6a-b5a5-a8ff8afe5d59 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:21.256885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab8d2e-4952-4e6a-b5a5-a8ff8afe5d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:21.272574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60386069-ba9a-4798-a5e6-ebaf421c7431 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:21.290075 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-35ab8d2e-4952-4e6a-b5a5-a8ff8afe5d59 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:21.291244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-35ab8d2e-4952-4e6a-b5a5-a8ff8afe5d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:21.308960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1179/2383] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:21.308960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318465-3512-4de2-a063-345359d4f6e7 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:21.308960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318465-3512-4de2-a063-345359d4f6e7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:21.310007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9318465-3512-4de2-a063-345359d4f6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:21.311687 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d5d58-e54b-4839-b687-086038dde61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:21.312753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d5d58-e54b-4839-b687-086038dde61b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:21.313253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d5d58-e54b-4839-b687-086038dde61b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:21.313777 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d5d58-e54b-4839-b687-086038dde61b admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:21.314814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d5d58-e54b-4839-b687-086038dde61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:21.339741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-c9318465-3512-4de2-a063-345359d4f6e7 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:21.340928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c9318465-3512-4de2-a063-345359d4f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:21.369250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d5d58-e54b-4839-b687-086038dde61b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:21.371409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1180/2384] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:21.372208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9318465-3512-4de2-a063-345359d4f6e7 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:21.373612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c9318465-3512-4de2-a063-345359d4f6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:21.400447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1205/2385] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:21.400447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d5d58-e54b-4839-b687-086038dde61b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:21.433253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d5d58-e54b-4839-b687-086038dde61b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:21.437285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f05d5-b3ac-4cea-afe4-0fc4ea5e4640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:21.437642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f05d5-b3ac-4cea-afe4-0fc4ea5e4640 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:21.438015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f05d5-b3ac-4cea-afe4-0fc4ea5e4640 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:21.438398 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f05d5-b3ac-4cea-afe4-0fc4ea5e4640 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:21.439292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f05d5-b3ac-4cea-afe4-0fc4ea5e4640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:21.439624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f05d5-b3ac-4cea-afe4-0fc4ea5e4640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:21.500039 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f05d5-b3ac-4cea-afe4-0fc4ea5e4640 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:21.527912 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9318465-3512-4de2-a063-345359d4f6e7 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:21.537042 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7be7b9-7e9a-46e1-8b96-71b08b37833d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:21.537284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1206/2386] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:14:21.537397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7be7b9-7e9a-46e1-8b96-71b08b37833d service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:21.537894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f05d5-b3ac-4cea-afe4-0fc4ea5e4640 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:21.538273 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7be7b9-7e9a-46e1-8b96-71b08b37833d service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:21.538577 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7be7b9-7e9a-46e1-8b96-71b08b37833d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:21.559295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7be7b9-7e9a-46e1-8b96-71b08b37833d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:21.561272 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f05d5-b3ac-4cea-afe4-0fc4ea5e4640 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:21.578852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a439d-4669-47ad-bd05-2c53deadabcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:21.579726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a439d-4669-47ad-bd05-2c53deadabcf admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:21.580010 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a439d-4669-47ad-bd05-2c53deadabcf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:21.580299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a439d-4669-47ad-bd05-2c53deadabcf admin admin] PATH_INFO: `/v3/projects/6ce3b4f48516448ab3243a6250791274/users/3e433455a4a64101813429e411f8c0ca/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:21.588169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a439d-4669-47ad-bd05-2c53deadabcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce3b4f48516448ab3243a6250791274, user_id=3e433455a4a64101813429e411f8c0ca, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:21.612477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7be7b9-7e9a-46e1-8b96-71b08b37833d service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:21.630286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1181/2387] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:21 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:21.632004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7be7b9-7e9a-46e1-8b96-71b08b37833d service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:21.655765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a439d-4669-47ad-bd05-2c53deadabcf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:21.662432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7be7b9-7e9a-46e1-8b96-71b08b37833d service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:21.680906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735e73-2b2a-41b2-a9f5-21dcec3f9896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:21.683478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735e73-2b2a-41b2-a9f5-21dcec3f9896 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:21.683919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735e73-2b2a-41b2-a9f5-21dcec3f9896 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:21.684412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94735e73-2b2a-41b2-a9f5-21dcec3f9896 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:21.686393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94735e73-2b2a-41b2-a9f5-21dcec3f9896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:21.771506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94735e73-2b2a-41b2-a9f5-21dcec3f9896 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:21.828234 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1207/2388] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:21 2022] PUT /identity/v3/projects/6ce3b4f48516448ab3243a6250791274/users/3e433455a4a64101813429e411f8c0ca/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:21.832338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5c3a-db48-4761-89e9-693c388b64d5 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:21.832873 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5c3a-db48-4761-89e9-693c388b64d5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:21.833458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5c3a-db48-4761-89e9-693c388b64d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:21.943458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-04ba5c3a-db48-4761-89e9-693c388b64d5 None None] MFA Rules not processed for user `3e433455a4a64101813429e411f8c0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:21.944847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-04ba5c3a-db48-4761-89e9-693c388b64d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:22.130193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1208/2389] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:21 2022] POST /identity/v3/auth/tokens => generated 3763 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:14:22.137468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5c3a-db48-4761-89e9-693c388b64d5 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:22.140929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-04ba5c3a-db48-4761-89e9-693c388b64d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:22.234650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1182/2390] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:21 2022] POST /identity/v3/projects => generated 385 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:22.235916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735e73-2b2a-41b2-a9f5-21dcec3f9896 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:22.278167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5c3a-db48-4761-89e9-693c388b64d5 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:22.446242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23924e-1fa0-4385-934e-1f2c092216fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:22.447110 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23924e-1fa0-4385-934e-1f2c092216fc service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:22.447634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23924e-1fa0-4385-934e-1f2c092216fc service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:22.447927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23924e-1fa0-4385-934e-1f2c092216fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:22.497401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94735e73-2b2a-41b2-a9f5-21dcec3f9896 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:22.508517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec05ac-d86b-47af-9577-9a83fd5b723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:22.509295 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec05ac-d86b-47af-9577-9a83fd5b723f admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:22.509685 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec05ac-d86b-47af-9577-9a83fd5b723f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:22.510069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec05ac-d86b-47af-9577-9a83fd5b723f admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:22.510813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec05ac-d86b-47af-9577-9a83fd5b723f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:22.578717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec05ac-d86b-47af-9577-9a83fd5b723f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:22.600629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23924e-1fa0-4385-934e-1f2c092216fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:22.637829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23924e-1fa0-4385-934e-1f2c092216fc service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:22.651678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1209/2391] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:22 2022] GET /identity/v3/auth/tokens => generated 3763 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:22.791934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1183/2392] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:22 2022] POST /identity/v3/users => generated 293 bytes in 554 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:22.793630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23924e-1fa0-4385-934e-1f2c092216fc service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:22.806339 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23924e-1fa0-4385-934e-1f2c092216fc service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:22.843092 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b8b0d-0973-454b-a60a-b8f3722ab57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:22.843732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b8b0d-0973-454b-a60a-b8f3722ab57f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:22.844018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b8b0d-0973-454b-a60a-b8f3722ab57f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:22.844299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b8b0d-0973-454b-a60a-b8f3722ab57f admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:22.849238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b8b0d-0973-454b-a60a-b8f3722ab57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:22.873372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec05ac-d86b-47af-9577-9a83fd5b723f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:22.888579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec05ac-d86b-47af-9577-9a83fd5b723f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:22.902005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:22.902920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:22.903226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:22.903528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] PATH_INFO: `/v3/users/5a747e28b05448ba83a4596457bb9b9d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:22.904669 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a747e28b05448ba83a4596457bb9b9d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:22.955151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b8b0d-0973-454b-a60a-b8f3722ab57f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:22.977611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:23.008933 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1210/2393] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:22 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:23.009361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b8b0d-0973-454b-a60a-b8f3722ab57f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:23.038161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-105b8b0d-0973-454b-a60a-b8f3722ab57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:23.081863 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b8b0d-0973-454b-a60a-b8f3722ab57f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:23.087098 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:23.087936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:23.088230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:23.088508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] PATH_INFO: `/v3/projects/1a5795016992488ea13ff3a5123b3cff` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:23.089652 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a5795016992488ea13ff3a5123b3cff)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:23.149680 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:23.445496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a747e28b05448ba83a4596457bb9b9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.494503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a747e28b05448ba83a4596457bb9b9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.494970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a5795016992488ea13ff3a5123b3cff', 'request_id': 'req-7ffd4551-003a-4649-a0c1-31e99871ed64'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.497392 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a747e28b05448ba83a4596457bb9b9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.525908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a747e28b05448ba83a4596457bb9b9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.614282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a5795016992488ea13ff3a5123b3cff', 'request_id': 'req-7ffd4551-003a-4649-a0c1-31e99871ed64'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.654254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a5795016992488ea13ff3a5123b3cff', 'request_id': 'req-7ffd4551-003a-4649-a0c1-31e99871ed64'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.690575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] The token cache is being invalidate because project 1a5795016992488ea13ff3a5123b3cff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:23.691268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.693073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.695739 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1211/2394] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:23 2022] DELETE /identity/v3/projects/1a5795016992488ea13ff3a5123b3cff => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:23.696746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:23.698296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:23.703728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-525eb145-df7b-47c4-8b50-6dfd78a69637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a747e28b05448ba83a4596457bb9b9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:23.714026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1184/2395] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:22 2022] DELETE /identity/v3/users/5a747e28b05448ba83a4596457bb9b9d => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:23.719259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d1a7-9ee5-4872-85f8-4598b9161f3f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:23.719876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d1a7-9ee5-4872-85f8-4598b9161f3f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:23.720320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986d1a7-9ee5-4872-85f8-4598b9161f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:23.797587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-2986d1a7-9ee5-4872-85f8-4598b9161f3f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:23.806770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-2986d1a7-9ee5-4872-85f8-4598b9161f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:23.860595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd4551-003a-4649-a0c1-31e99871ed64 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:24.002162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2fd68-2de6-4fe9-8c6a-896dd7e3233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:24.005744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2fd68-2de6-4fe9-8c6a-896dd7e3233a admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:24.006356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2fd68-2de6-4fe9-8c6a-896dd7e3233a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:24.007512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2fd68-2de6-4fe9-8c6a-896dd7e3233a admin admin] PATH_INFO: `/v3/projects/c5ee90cc67ab40cd8bef0b0639fee7fe/users/1d5d20d1cfd543d989cd803c592d4ca3/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:24.101861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1185/2396] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:23 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:24.119194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d1a7-9ee5-4872-85f8-4598b9161f3f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:24.120570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-2986d1a7-9ee5-4872-85f8-4598b9161f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:24.224701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2fd68-2de6-4fe9-8c6a-896dd7e3233a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ee90cc67ab40cd8bef0b0639fee7fe, user_id=1d5d20d1cfd543d989cd803c592d4ca3, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:24.298224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986d1a7-9ee5-4872-85f8-4598b9161f3f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:24.303212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2fd68-2de6-4fe9-8c6a-896dd7e3233a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:24.305589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4d30f-2c2e-4fe4-a8c9-8f23c6ab6ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:24.306190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d30f-2c2e-4fe4-a8c9-8f23c6ab6ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:24.306475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d30f-2c2e-4fe4-a8c9-8f23c6ab6ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:24.306757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d30f-2c2e-4fe4-a8c9-8f23c6ab6ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:24.334323 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4d30f-2c2e-4fe4-a8c9-8f23c6ab6ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:24.413103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4d30f-2c2e-4fe4-a8c9-8f23c6ab6ab3 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:24.414081 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1212/2397] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:23 2022] PUT /identity/v3/projects/c5ee90cc67ab40cd8bef0b0639fee7fe/users/1d5d20d1cfd543d989cd803c592d4ca3/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:24.418926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8ef2a-3161-41c4-9cc6-03a6b887cfe3 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:24.419729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8ef2a-3161-41c4-9cc6-03a6b887cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:24.420774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8ef2a-3161-41c4-9cc6-03a6b887cfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:24.443979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1186/2398] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:24.496147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1af8ef2a-3161-41c4-9cc6-03a6b887cfe3 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:24.499421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1af8ef2a-3161-41c4-9cc6-03a6b887cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:24.720671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1213/2399] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:24.758974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4d30f-2c2e-4fe4-a8c9-8f23c6ab6ab3 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:24.773938 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4d30f-2c2e-4fe4-a8c9-8f23c6ab6ab3 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:24.901674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e9418-59d9-4ec6-b1f4-1803a08b3155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:24.902584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e9418-59d9-4ec6-b1f4-1803a08b3155 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:24.903029 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e9418-59d9-4ec6-b1f4-1803a08b3155 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:24.903510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e9418-59d9-4ec6-b1f4-1803a08b3155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:24.921579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e9418-59d9-4ec6-b1f4-1803a08b3155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:24.991248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e9418-59d9-4ec6-b1f4-1803a08b3155 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:25.002311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1187/2400] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:24 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:26.380946 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8ef2a-3161-41c4-9cc6-03a6b887cfe3 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:26.383502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1af8ef2a-3161-41c4-9cc6-03a6b887cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:26.401955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8ef2a-3161-41c4-9cc6-03a6b887cfe3 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:26.416313 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:26.417196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:26.417434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:26.417810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] PATH_INFO: `/v3/projects/929cc7a635d143cead0816a80c11e3a9` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:26.419109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=929cc7a635d143cead0816a80c11e3a9)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:26.522974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:26.819363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929cc7a635d143cead0816a80c11e3a9', 'request_id': 'req-4c2670e6-5ec9-4e83-a93e-951396c7cf82'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:26.915967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929cc7a635d143cead0816a80c11e3a9', 'request_id': 'req-4c2670e6-5ec9-4e83-a93e-951396c7cf82'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:26.942927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929cc7a635d143cead0816a80c11e3a9', 'request_id': 'req-4c2670e6-5ec9-4e83-a93e-951396c7cf82'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:26.995254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] The token cache is being invalidate because project 929cc7a635d143cead0816a80c11e3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:26.995590 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:26.998608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:27.001645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1214/2401] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:26 2022] DELETE /identity/v3/projects/929cc7a635d143cead0816a80c11e3a9 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:27.006778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e9418-59d9-4ec6-b1f4-1803a08b3155 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:27.016860 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e9418-59d9-4ec6-b1f4-1803a08b3155 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:27.255082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:27.258107 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:27.258939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:27.263406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] PATH_INFO: `/v3/users/3e433455a4a64101813429e411f8c0ca` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:27.267595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e433455a4a64101813429e411f8c0ca)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:27.337406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:27.658747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e433455a4a64101813429e411f8c0ca'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:27.702363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e433455a4a64101813429e411f8c0ca'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:27.707199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e433455a4a64101813429e411f8c0ca'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:27.740108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e433455a4a64101813429e411f8c0ca'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:27.934381 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-45db1d43-2204-4666-8b61-bd7592e8a5c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e433455a4a64101813429e411f8c0ca'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:27.960008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1188/2402] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:27 2022] DELETE /identity/v3/users/3e433455a4a64101813429e411f8c0ca => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:29.642700 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:29.644335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:29.674843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2670e6-5ec9-4e83-a93e-951396c7cf82 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:29.838559 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:29.842363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:29.842840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:29.843472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] PATH_INFO: `/v3/projects/6ce3b4f48516448ab3243a6250791274` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:29.844845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce3b4f48516448ab3243a6250791274)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:29.883565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:30.252805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce3b4f48516448ab3243a6250791274', 'request_id': 'req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:30.368555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce3b4f48516448ab3243a6250791274', 'request_id': 'req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:30.393763 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce3b4f48516448ab3243a6250791274', 'request_id': 'req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:30.426663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] The token cache is being invalidate because project 6ce3b4f48516448ab3243a6250791274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:30.429863 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:30.435170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-535d2c8e-b7f9-454e-b1e7-6e1c622fe97a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:30.438761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1215/2403] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:29 2022] DELETE /identity/v3/projects/6ce3b4f48516448ab3243a6250791274 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:30.447991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa9d65-6231-4cad-87e0-b336c066111e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:30.448536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa9d65-6231-4cad-87e0-b336c066111e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:30.449003 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa9d65-6231-4cad-87e0-b336c066111e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:30.530613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-89aa9d65-6231-4cad-87e0-b336c066111e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:30.531941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-89aa9d65-6231-4cad-87e0-b336c066111e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:30.689375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1189/2404] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:30.697630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8112c3d-c6e1-4cbc-b677-1cfb4e19b92b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:30.698482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8112c3d-c6e1-4cbc-b677-1cfb4e19b92b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:30.698482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8112c3d-c6e1-4cbc-b677-1cfb4e19b92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:30.740833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f8112c3d-c6e1-4cbc-b677-1cfb4e19b92b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:30.742047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f8112c3d-c6e1-4cbc-b677-1cfb4e19b92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:30.765478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1216/2405] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:14:30.766551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa9d65-6231-4cad-87e0-b336c066111e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:30.786500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa9d65-6231-4cad-87e0-b336c066111e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:30.806778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e5624-ca72-4661-9494-5ba2a6f5491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:30.807447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5624-ca72-4661-9494-5ba2a6f5491f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:30.807803 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5624-ca72-4661-9494-5ba2a6f5491f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:30.808149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5624-ca72-4661-9494-5ba2a6f5491f admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:30.808925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e5624-ca72-4661-9494-5ba2a6f5491f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:30.809318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e5624-ca72-4661-9494-5ba2a6f5491f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:30.876871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e5624-ca72-4661-9494-5ba2a6f5491f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:30.924592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1190/2406] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:14:30.928802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8112c3d-c6e1-4cbc-b677-1cfb4e19b92b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:30.940577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8112c3d-c6e1-4cbc-b677-1cfb4e19b92b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:30.961011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcdf76-3e39-4502-bbbb-2ab03d88ae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:30.961624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcdf76-3e39-4502-bbbb-2ab03d88ae0d admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:30.961917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcdf76-3e39-4502-bbbb-2ab03d88ae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:30.962212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcdf76-3e39-4502-bbbb-2ab03d88ae0d admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:30.962849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fcdf76-3e39-4502-bbbb-2ab03d88ae0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:31.094631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fcdf76-3e39-4502-bbbb-2ab03d88ae0d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:31.346886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1217/2407] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:30 2022] POST /identity/v3/projects => generated 359 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:31.347458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e5624-ca72-4661-9494-5ba2a6f5491f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:31.370782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e5624-ca72-4661-9494-5ba2a6f5491f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:31.540005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b1beb-ba63-44ed-b0bb-6ae96de07a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:31.543032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b1beb-ba63-44ed-b0bb-6ae96de07a80 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:31.546634 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b1beb-ba63-44ed-b0bb-6ae96de07a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:31.547683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b1beb-ba63-44ed-b0bb-6ae96de07a80 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:31.550132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b1beb-ba63-44ed-b0bb-6ae96de07a80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:31.619770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7b1beb-ba63-44ed-b0bb-6ae96de07a80 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:31.744655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1191/2408] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:31 2022] POST /identity/v3/users => generated 280 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:31.748745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcdf76-3e39-4502-bbbb-2ab03d88ae0d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:31.780925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcdf76-3e39-4502-bbbb-2ab03d88ae0d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:31.790585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072fa55-f86f-4960-9820-e245aeacf34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:31.791298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072fa55-f86f-4960-9820-e245aeacf34b admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:31.791844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072fa55-f86f-4960-9820-e245aeacf34b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:31.794363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072fa55-f86f-4960-9820-e245aeacf34b admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:31.795201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072fa55-f86f-4960-9820-e245aeacf34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:31.836496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072fa55-f86f-4960-9820-e245aeacf34b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:31.850108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1218/2409] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:31.854228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b1beb-ba63-44ed-b0bb-6ae96de07a80 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:31.869141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b1beb-ba63-44ed-b0bb-6ae96de07a80 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:31.893544 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacab74-9b29-4786-8ce1-296844ba6f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:31.897758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacab74-9b29-4786-8ce1-296844ba6f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:31.897758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacab74-9b29-4786-8ce1-296844ba6f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:31.897758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacab74-9b29-4786-8ce1-296844ba6f1f admin admin] PATH_INFO: `/v3/projects/71938073568e4cb58dbbc3ddd2bc7bf1/users/170b56b63a5b4756ae4e88bee1bb7163/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:31.957805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacab74-9b29-4786-8ce1-296844ba6f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=71938073568e4cb58dbbc3ddd2bc7bf1, user_id=170b56b63a5b4756ae4e88bee1bb7163, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:32.018996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacab74-9b29-4786-8ce1-296844ba6f1f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:32.136796 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1192/2410] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:31 2022] PUT /identity/v3/projects/71938073568e4cb58dbbc3ddd2bc7bf1/users/170b56b63a5b4756ae4e88bee1bb7163/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:32.149156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ab87-ee49-4a8b-a304-95d0201bebe8 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:32.149511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ab87-ee49-4a8b-a304-95d0201bebe8 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:32.150046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72ab87-ee49-4a8b-a304-95d0201bebe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:32.301244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-df72ab87-ee49-4a8b-a304-95d0201bebe8 None None] MFA Rules not processed for user `170b56b63a5b4756ae4e88bee1bb7163`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:32.306427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-df72ab87-ee49-4a8b-a304-95d0201bebe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:32.493811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1219/2411] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:32 2022] POST /identity/v3/auth/tokens => generated 3666 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:32.519701 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e59ccc-6eb0-4992-9149-250bbb3511c6 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:32.520524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e59ccc-6eb0-4992-9149-250bbb3511c6 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:32.521049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e59ccc-6eb0-4992-9149-250bbb3511c6 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:32.523532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1193/2412] 10.222.0.87 () {54 vars in 962 bytes} [Tue Jan 18 13:14:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:14:32.529138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7f58-ee79-4f55-b187-6466ce5c5320 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:32.535529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7f58-ee79-4f55-b187-6466ce5c5320 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:32.535529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7f58-ee79-4f55-b187-6466ce5c5320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:32.642807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b75a7f58-ee79-4f55-b187-6466ce5c5320 None None] MFA Rules not processed for user `f6fb4643e93c455c9eb828c52b68bbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:32.643939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b75a7f58-ee79-4f55-b187-6466ce5c5320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:32.818207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1220/2413] 10.222.0.87 () {58 vars in 1059 bytes} [Tue Jan 18 13:14:32 2022] POST /identity/v3/auth/tokens => generated 3550 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:32.826568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e59ccc-6eb0-4992-9149-250bbb3511c6 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:32.845696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e59ccc-6eb0-4992-9149-250bbb3511c6 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:32.857504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b813032-7203-4321-8785-b06f0e738b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:32.858419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b813032-7203-4321-8785-b06f0e738b6e service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:32.858879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b813032-7203-4321-8785-b06f0e738b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:32.859322 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b813032-7203-4321-8785-b06f0e738b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:32.883999 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b813032-7203-4321-8785-b06f0e738b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:32.954394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b813032-7203-4321-8785-b06f0e738b6e service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:32.981616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1194/2414] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:32 2022] GET /identity/v3/auth/tokens => generated 3666 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:33.369175 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a7f58-ee79-4f55-b187-6466ce5c5320 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:33.561825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a7f58-ee79-4f55-b187-6466ce5c5320 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:33.587972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:33.590928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:33.591226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:33.591503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] PATH_INFO: `/v3/users/170b56b63a5b4756ae4e88bee1bb7163` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:33.596975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170b56b63a5b4756ae4e88bee1bb7163)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:33.665201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:34.000829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170b56b63a5b4756ae4e88bee1bb7163'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:34.002872 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170b56b63a5b4756ae4e88bee1bb7163'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:34.068120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170b56b63a5b4756ae4e88bee1bb7163'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:34.111561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170b56b63a5b4756ae4e88bee1bb7163'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:34.212138 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170b56b63a5b4756ae4e88bee1bb7163'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:34.219655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1221/2415] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:33 2022] DELETE /identity/v3/users/170b56b63a5b4756ae4e88bee1bb7163 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:34.225356 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8860-2e78-4b01-83e3-d1045807b3d8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:34.225930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8860-2e78-4b01-83e3-d1045807b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:34.226045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fc8860-2e78-4b01-83e3-d1045807b3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:34.279478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-a2fc8860-2e78-4b01-83e3-d1045807b3d8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:34.279478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a2fc8860-2e78-4b01-83e3-d1045807b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:34.499765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1195/2416] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:34.516587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:34.518164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:34.693935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d7d1e-236c-4227-8ffb-059cb5716ed8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:34.705637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d7c40-1f7e-4035-a8a7-5dc4d9487af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:34.706605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7c40-1f7e-4035-a8a7-5dc4d9487af5 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:34.708191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7c40-1f7e-4035-a8a7-5dc4d9487af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:34.710297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7c40-1f7e-4035-a8a7-5dc4d9487af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:34.745606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d7c40-1f7e-4035-a8a7-5dc4d9487af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:34.856662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d7c40-1f7e-4035-a8a7-5dc4d9487af5 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:34.916854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1222/2417] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:34 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:36.777658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc8860-2e78-4b01-83e3-d1045807b3d8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:36.778362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a2fc8860-2e78-4b01-83e3-d1045807b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:36.806417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fc8860-2e78-4b01-83e3-d1045807b3d8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:36.810030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:36.810933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:36.811195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:36.811537 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] PATH_INFO: `/v3/projects/71938073568e4cb58dbbc3ddd2bc7bf1` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:36.814242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71938073568e4cb58dbbc3ddd2bc7bf1)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:36.869101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:37.132000 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71938073568e4cb58dbbc3ddd2bc7bf1', 'request_id': 'req-a54985b7-c0b9-4d9b-9f32-e38cda961430'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.252072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d7c40-1f7e-4035-a8a7-5dc4d9487af5 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:37.257087 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-908d7c40-1f7e-4035-a8a7-5dc4d9487af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:37.282344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d7c40-1f7e-4035-a8a7-5dc4d9487af5 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:37.412293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:37.413503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:37.415745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:37.416055 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] PATH_INFO: `/v3/users/06f95f6d30c24a62890200a4ed5ae1d4` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:37.417279 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f95f6d30c24a62890200a4ed5ae1d4)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:37.436043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71938073568e4cb58dbbc3ddd2bc7bf1', 'request_id': 'req-a54985b7-c0b9-4d9b-9f32-e38cda961430'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.447663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:37.468372 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71938073568e4cb58dbbc3ddd2bc7bf1', 'request_id': 'req-a54985b7-c0b9-4d9b-9f32-e38cda961430'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.481944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] The token cache is being invalidate because project 71938073568e4cb58dbbc3ddd2bc7bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:37.482596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.483541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.491848 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1196/2418] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:36 2022] DELETE /identity/v3/projects/71938073568e4cb58dbbc3ddd2bc7bf1 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:37.493283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:37.494852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:37.629868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54985b7-c0b9-4d9b-9f32-e38cda961430 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:37.633651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effab45-ecaf-4274-ad6f-9e8643861a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:37.639196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effab45-ecaf-4274-ad6f-9e8643861a60 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:37.639196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effab45-ecaf-4274-ad6f-9e8643861a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:37.639196 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effab45-ecaf-4274-ad6f-9e8643861a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:37.646718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6effab45-ecaf-4274-ad6f-9e8643861a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:37.713958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f95f6d30c24a62890200a4ed5ae1d4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.714919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f95f6d30c24a62890200a4ed5ae1d4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.730973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f95f6d30c24a62890200a4ed5ae1d4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.746326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f95f6d30c24a62890200a4ed5ae1d4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.854736 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effab45-ecaf-4274-ad6f-9e8643861a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:37.872308 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-74f2da2b-66f4-4303-9423-bd1319a92120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f95f6d30c24a62890200a4ed5ae1d4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:37.880756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1223/2419] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:37 2022] DELETE /identity/v3/users/06f95f6d30c24a62890200a4ed5ae1d4 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:37.882448 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869444d2-65d9-4d3e-9a34-e0659040171e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:37.885468 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869444d2-65d9-4d3e-9a34-e0659040171e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:37.885920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effab45-ecaf-4274-ad6f-9e8643861a60 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:37.886139 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869444d2-65d9-4d3e-9a34-e0659040171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:37.917985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1197/2420] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:37 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:37.920575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2250-8631-4358-8dcd-5a134548ac8c None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:37.922362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2250-8631-4358-8dcd-5a134548ac8c None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:37.922757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a2250-8631-4358-8dcd-5a134548ac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:37.959103 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-869444d2-65d9-4d3e-9a34-e0659040171e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:37.960397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-869444d2-65d9-4d3e-9a34-e0659040171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:37.983399 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-865a2250-8631-4358-8dcd-5a134548ac8c None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:37.984671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-865a2250-8631-4358-8dcd-5a134548ac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:38.118376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1224/2421] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:38.128186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a04c-bcf0-46dc-82ae-0b5b0d8659e1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:38.130496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a04c-bcf0-46dc-82ae-0b5b0d8659e1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:38.131167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8a04c-bcf0-46dc-82ae-0b5b0d8659e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:38.154369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1198/2422] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:37 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:38.177420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a2250-8631-4358-8dcd-5a134548ac8c None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:38.179388 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-865a2250-8631-4358-8dcd-5a134548ac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:38.243101 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a3e8a04c-bcf0-46dc-82ae-0b5b0d8659e1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:38.244150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a3e8a04c-bcf0-46dc-82ae-0b5b0d8659e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:38.276997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1225/2423] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:38.278549 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8a04c-bcf0-46dc-82ae-0b5b0d8659e1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:38.290490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8a04c-bcf0-46dc-82ae-0b5b0d8659e1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:38.311117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a2250-8631-4358-8dcd-5a134548ac8c None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:38.319192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f9333-d002-419c-bfe8-98d265e4d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:38.319192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f9333-d002-419c-bfe8-98d265e4d9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:38.319192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f9333-d002-419c-bfe8-98d265e4d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:38.319192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f9333-d002-419c-bfe8-98d265e4d9b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:38.319615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f9333-d002-419c-bfe8-98d265e4d9b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:38.319615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f9333-d002-419c-bfe8-98d265e4d9b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:38.319996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622959f9-46d7-443b-bba6-278db3c80d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:38.320814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622959f9-46d7-443b-bba6-278db3c80d30 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:38.321170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622959f9-46d7-443b-bba6-278db3c80d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:38.321515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622959f9-46d7-443b-bba6-278db3c80d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:38.340198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622959f9-46d7-443b-bba6-278db3c80d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:38.375379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622959f9-46d7-443b-bba6-278db3c80d30 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:38.378055 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f9333-d002-419c-bfe8-98d265e4d9b8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:38.388952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1199/2424] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:38.423085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1226/2425] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:14:38.429124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622959f9-46d7-443b-bba6-278db3c80d30 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:38.454870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622959f9-46d7-443b-bba6-278db3c80d30 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:38.474387 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30634c2-a499-4fc4-b485-537a65c19aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:38.475519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30634c2-a499-4fc4-b485-537a65c19aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:38.475907 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30634c2-a499-4fc4-b485-537a65c19aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:38.476286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30634c2-a499-4fc4-b485-537a65c19aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:38.477545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30634c2-a499-4fc4-b485-537a65c19aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:38.521329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30634c2-a499-4fc4-b485-537a65c19aa2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:38.667621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1200/2426] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:38 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:38.667856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f9333-d002-419c-bfe8-98d265e4d9b8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:38.677547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f9333-d002-419c-bfe8-98d265e4d9b8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:38.794674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7ef7c-c2c6-49e9-b6c6-df1f14d3fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:38.795718 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7ef7c-c2c6-49e9-b6c6-df1f14d3fa46 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:38.796014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7ef7c-c2c6-49e9-b6c6-df1f14d3fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:38.796296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d7ef7c-c2c6-49e9-b6c6-df1f14d3fa46 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:38.797004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7ef7c-c2c6-49e9-b6c6-df1f14d3fa46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:38.837087 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d7ef7c-c2c6-49e9-b6c6-df1f14d3fa46 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:38.996230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1227/2427] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:38 2022] POST /identity/v3/users => generated 289 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:14:39.000524 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30634c2-a499-4fc4-b485-537a65c19aa2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:39.017184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30634c2-a499-4fc4-b485-537a65c19aa2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:39.041656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7de09-1d51-4b23-9291-3e82d12b6f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:39.042977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7de09-1d51-4b23-9291-3e82d12b6f9d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:39.044741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7de09-1d51-4b23-9291-3e82d12b6f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:39.045081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7de09-1d51-4b23-9291-3e82d12b6f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:39.048141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7de09-1d51-4b23-9291-3e82d12b6f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:39.112044 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7de09-1d51-4b23-9291-3e82d12b6f9d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:39.127184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1201/2428] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:38 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:39.141804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7ef7c-c2c6-49e9-b6c6-df1f14d3fa46 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:39.162819 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d7ef7c-c2c6-49e9-b6c6-df1f14d3fa46 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:39.186485 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a7629-301a-40a5-b97a-ba4784fa4a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:39.187298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a7629-301a-40a5-b97a-ba4784fa4a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:39.187575 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a7629-301a-40a5-b97a-ba4784fa4a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:39.187860 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a7629-301a-40a5-b97a-ba4784fa4a49 admin admin] PATH_INFO: `/v3/projects/84a0be2dd4d74d14872cf739718e32c6/users/d893914e233748aaa15e357f305a7587/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:39.231745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a7629-301a-40a5-b97a-ba4784fa4a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0be2dd4d74d14872cf739718e32c6, user_id=d893914e233748aaa15e357f305a7587, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:39.267242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a7629-301a-40a5-b97a-ba4784fa4a49 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:39.402363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1228/2429] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:39 2022] PUT /identity/v3/projects/84a0be2dd4d74d14872cf739718e32c6/users/d893914e233748aaa15e357f305a7587/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:39.412750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab6b00-f326-4463-83d3-08acfee92d00 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:39.416641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab6b00-f326-4463-83d3-08acfee92d00 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:39.416641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab6b00-f326-4463-83d3-08acfee92d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:39.425495 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a7629-301a-40a5-b97a-ba4784fa4a49 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:39.428893 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-9e6a7629-301a-40a5-b97a-ba4784fa4a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:39.536122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-a8ab6b00-f326-4463-83d3-08acfee92d00 None None] MFA Rules not processed for user `d893914e233748aaa15e357f305a7587`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:39.539067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a8ab6b00-f326-4463-83d3-08acfee92d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:39.623659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a7629-301a-40a5-b97a-ba4784fa4a49 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:39.637654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:39.638922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:39.639514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:39.645583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] PATH_INFO: `/v3/projects/29adb943d7e44e99a789026b518082bf` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:39.645583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29adb943d7e44e99a789026b518082bf)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:39.683483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1202/2430] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:39 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:39.686462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:39.689567 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab6b00-f326-4463-83d3-08acfee92d00 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:39.789428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab6b00-f326-4463-83d3-08acfee92d00 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:39.793165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:39.794753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:39.794753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:39.794753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:39.796488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:39.880082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29adb943d7e44e99a789026b518082bf', 'request_id': 'req-501e48ee-212c-4271-b4e3-311b1c1a869b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:39.896450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:39.924001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:39.944016 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1203/2431] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:39 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:39.944868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:39.946127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:39.954952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29adb943d7e44e99a789026b518082bf', 'request_id': 'req-501e48ee-212c-4271-b4e3-311b1c1a869b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:39.972690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29adb943d7e44e99a789026b518082bf', 'request_id': 'req-501e48ee-212c-4271-b4e3-311b1c1a869b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:39.983750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] The token cache is being invalidate because project 29adb943d7e44e99a789026b518082bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:39.984035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:39.989922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-501e48ee-212c-4271-b4e3-311b1c1a869b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:39.997335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1229/2432] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:39 2022] DELETE /identity/v3/projects/29adb943d7e44e99a789026b518082bf => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:39.998214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f26fe-0f5a-4bbf-b0e9-66feca515ef4 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:39.998512 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f26fe-0f5a-4bbf-b0e9-66feca515ef4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:39.998814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f26fe-0f5a-4bbf-b0e9-66feca515ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.035951 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e24f26fe-0f5a-4bbf-b0e9-66feca515ef4 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:40.037241 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e24f26fe-0f5a-4bbf-b0e9-66feca515ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:40.079784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706581d-0fff-4880-a600-b2bdd1156a69 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:40.133715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1230/2433] 10.222.0.87 () {58 vars in 967 bytes} [Tue Jan 18 13:14:39 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:40.140245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b1ce7-c910-4b8a-9b2a-4f727b97b0f4 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.140515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b1ce7-c910-4b8a-9b2a-4f727b97b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.141093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b1ce7-c910-4b8a-9b2a-4f727b97b0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.174577 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:40.176076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.176076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.176483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.178257 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:40.193089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-669b1ce7-c910-4b8a-9b2a-4f727b97b0f4 None None] MFA Rules not processed for user `1d5d20d1cfd543d989cd803c592d4ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:40.194454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-669b1ce7-c910-4b8a-9b2a-4f727b97b0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:40.252632 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:40.274097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1231/2434] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:40.275707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08acbcb-8c56-40af-b3fa-a4cf2f37e1ec None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.275915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08acbcb-8c56-40af-b3fa-a4cf2f37e1ec None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.276197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08acbcb-8c56-40af-b3fa-a4cf2f37e1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.282057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:40.293172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1204/2435] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:39 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:40.294109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:40.295499 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:40.303854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b08acbcb-8c56-40af-b3fa-a4cf2f37e1ec None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:40.305186 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b08acbcb-8c56-40af-b3fa-a4cf2f37e1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:40.387524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1232/2436] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:40.392829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08acbcb-8c56-40af-b3fa-a4cf2f37e1ec None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:40.396370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b08acbcb-8c56-40af-b3fa-a4cf2f37e1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:40.410112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08acbcb-8c56-40af-b3fa-a4cf2f37e1ec None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:40.414864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831852a1-96cf-412b-8b33-3a690f0329db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:40.416209 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831852a1-96cf-412b-8b33-3a690f0329db admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.416582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831852a1-96cf-412b-8b33-3a690f0329db admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.416938 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831852a1-96cf-412b-8b33-3a690f0329db admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.418076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831852a1-96cf-412b-8b33-3a690f0329db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:40.447584 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831852a1-96cf-412b-8b33-3a690f0329db admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:40.478166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc152-a993-479a-99b5-9cfd7fc45b4d service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:40.483325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeabf42-7a01-47eb-a02e-c76aeee61f4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:40.484012 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeabf42-7a01-47eb-a02e-c76aeee61f4b service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.484303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeabf42-7a01-47eb-a02e-c76aeee61f4b service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.484581 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeabf42-7a01-47eb-a02e-c76aeee61f4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.494244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeabf42-7a01-47eb-a02e-c76aeee61f4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:40.523670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeabf42-7a01-47eb-a02e-c76aeee61f4b service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:40.532596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1205/2437] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:14:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:14:40.534553 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065ed76-3056-4f72-8e10-6daa3e2f746e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.534553 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065ed76-3056-4f72-8e10-6daa3e2f746e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.534911 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065ed76-3056-4f72-8e10-6daa3e2f746e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.571187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-4065ed76-3056-4f72-8e10-6daa3e2f746e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:40.574820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1233/2438] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:40 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:40.574937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4065ed76-3056-4f72-8e10-6daa3e2f746e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:40.575921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831852a1-96cf-412b-8b33-3a690f0329db admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:40.648068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1206/2439] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:40.652444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065ed76-3056-4f72-8e10-6daa3e2f746e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:40.654582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831852a1-96cf-412b-8b33-3a690f0329db admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:40.659114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f0b7f-4a14-4320-9c28-87d2853cf0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:40.660327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0b7f-4a14-4320-9c28-87d2853cf0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.661244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0b7f-4a14-4320-9c28-87d2853cf0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.661534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f0b7f-4a14-4320-9c28-87d2853cf0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.662117 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065ed76-3056-4f72-8e10-6daa3e2f746e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:40.662236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f0b7f-4a14-4320-9c28-87d2853cf0e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:40.666787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bdda9-9766-4eac-a519-91b84dff142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:40.667354 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bdda9-9766-4eac-a519-91b84dff142f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.667646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bdda9-9766-4eac-a519-91b84dff142f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.667936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bdda9-9766-4eac-a519-91b84dff142f admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.668629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bdda9-9766-4eac-a519-91b84dff142f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:40.668931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bdda9-9766-4eac-a519-91b84dff142f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:40.688874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f0b7f-4a14-4320-9c28-87d2853cf0e6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:40.694325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bdda9-9766-4eac-a519-91b84dff142f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:40.708573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1207/2440] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:14:40.712831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bdda9-9766-4eac-a519-91b84dff142f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:40.722766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bdda9-9766-4eac-a519-91b84dff142f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:40.727060 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f987-3f63-47ea-81f0-77ba38ec57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:40.727678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f987-3f63-47ea-81f0-77ba38ec57a9 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.727962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f987-3f63-47ea-81f0-77ba38ec57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.728244 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f987-3f63-47ea-81f0-77ba38ec57a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.728870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278f987-3f63-47ea-81f0-77ba38ec57a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:40.755231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278f987-3f63-47ea-81f0-77ba38ec57a9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:40.830528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1234/2441] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:40 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:40.839385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f0b7f-4a14-4320-9c28-87d2853cf0e6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:40.849230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f0b7f-4a14-4320-9c28-87d2853cf0e6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:40.853551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632147c1-49c9-4800-a1da-9cbeb0edf400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:40.854143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632147c1-49c9-4800-a1da-9cbeb0edf400 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.854430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632147c1-49c9-4800-a1da-9cbeb0edf400 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.854713 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632147c1-49c9-4800-a1da-9cbeb0edf400 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:40.855441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632147c1-49c9-4800-a1da-9cbeb0edf400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:40.881470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632147c1-49c9-4800-a1da-9cbeb0edf400 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:40.892480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1235/2442] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:14:40.898121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632147c1-49c9-4800-a1da-9cbeb0edf400 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:40.908119 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632147c1-49c9-4800-a1da-9cbeb0edf400 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:40.910830 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1208/2443] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:40 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:14:40.920021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f987-3f63-47ea-81f0-77ba38ec57a9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:40.980362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745efec-a8c1-4382-8268-f9f408585b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:40.981242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745efec-a8c1-4382-8268-f9f408585b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:40.981533 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745efec-a8c1-4382-8268-f9f408585b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:40.981818 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745efec-a8c1-4382-8268-f9f408585b52 admin admin] PATH_INFO: `/v3/projects/6aa87380d6ee4a70b2fdc35cdcb31ae3/users/96ffc47737804d2f90cc71a61c136d8a/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:41.001081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f987-3f63-47ea-81f0-77ba38ec57a9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:41.001383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745efec-a8c1-4382-8268-f9f408585b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa87380d6ee4a70b2fdc35cdcb31ae3, user_id=96ffc47737804d2f90cc71a61c136d8a, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:41.006026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ec0ab-955a-41bc-86e7-56780dd03436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:41.006559 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec0ab-955a-41bc-86e7-56780dd03436 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:41.006842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec0ab-955a-41bc-86e7-56780dd03436 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:41.007122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ec0ab-955a-41bc-86e7-56780dd03436 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:41.007774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ec0ab-955a-41bc-86e7-56780dd03436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:41.032023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9745efec-a8c1-4382-8268-f9f408585b52 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:41.034271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ec0ab-955a-41bc-86e7-56780dd03436 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:41.124306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1236/2444] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:40 2022] PUT /identity/v3/projects/6aa87380d6ee4a70b2fdc35cdcb31ae3/users/96ffc47737804d2f90cc71a61c136d8a/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:41.128927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745efec-a8c1-4382-8268-f9f408585b52 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:41.152507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1209/2445] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:40 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:41.156323 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ec0ab-955a-41bc-86e7-56780dd03436 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:41.168094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ec0ab-955a-41bc-86e7-56780dd03436 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:41.256637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745efec-a8c1-4382-8268-f9f408585b52 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:41.261802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ec12-3f69-4c2e-9d0e-2d5080aeaa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:41.262760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ec12-3f69-4c2e-9d0e-2d5080aeaa59 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:41.263204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ec12-3f69-4c2e-9d0e-2d5080aeaa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:41.263671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc08ec12-3f69-4c2e-9d0e-2d5080aeaa59 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:41.264703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08ec12-3f69-4c2e-9d0e-2d5080aeaa59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:41.295814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc08ec12-3f69-4c2e-9d0e-2d5080aeaa59 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:41.309172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1237/2446] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:41.313486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ec12-3f69-4c2e-9d0e-2d5080aeaa59 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:41.328245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc08ec12-3f69-4c2e-9d0e-2d5080aeaa59 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:41.336801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2497ea-6950-4069-b9c6-081c56313261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:41.337489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2497ea-6950-4069-b9c6-081c56313261 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:41.337854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2497ea-6950-4069-b9c6-081c56313261 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:41.338210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2497ea-6950-4069-b9c6-081c56313261 admin admin] PATH_INFO: `/v3/projects/6aa87380d6ee4a70b2fdc35cdcb31ae3/users/96ffc47737804d2f90cc71a61c136d8a/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:41.338722 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722a326-87ed-4950-911e-0230c8d91436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:41.339629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a326-87ed-4950-911e-0230c8d91436 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:41.340116 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a326-87ed-4950-911e-0230c8d91436 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:41.340513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2497ea-6950-4069-b9c6-081c56313261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa87380d6ee4a70b2fdc35cdcb31ae3, user_id=96ffc47737804d2f90cc71a61c136d8a, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:41.342270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722a326-87ed-4950-911e-0230c8d91436 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:41.343205 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722a326-87ed-4950-911e-0230c8d91436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:41.371647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2497ea-6950-4069-b9c6-081c56313261 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:41.386326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1238/2447] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:41 2022] PUT /identity/v3/projects/6aa87380d6ee4a70b2fdc35cdcb31ae3/users/96ffc47737804d2f90cc71a61c136d8a/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:41.390253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2497ea-6950-4069-b9c6-081c56313261 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:41.400229 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722a326-87ed-4950-911e-0230c8d91436 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:41.436668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1210/2448] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:14:41.437825 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722a326-87ed-4950-911e-0230c8d91436 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:41.462103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722a326-87ed-4950-911e-0230c8d91436 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:41.527620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2497ea-6950-4069-b9c6-081c56313261 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:41.533247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffecd63-58c7-45d8-bc0a-61274f76ddc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:41.533850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffecd63-58c7-45d8-bc0a-61274f76ddc3 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:41.535246 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffecd63-58c7-45d8-bc0a-61274f76ddc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:41.535644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffecd63-58c7-45d8-bc0a-61274f76ddc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:41.536735 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffecd63-58c7-45d8-bc0a-61274f76ddc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:41.574483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffecd63-58c7-45d8-bc0a-61274f76ddc3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:41.579161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e8896-f1ab-474f-a2f7-4aab53bcbf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:41.580813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e8896-f1ab-474f-a2f7-4aab53bcbf7d admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:41.581328 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e8896-f1ab-474f-a2f7-4aab53bcbf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:41.583299 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e8896-f1ab-474f-a2f7-4aab53bcbf7d admin admin] PATH_INFO: `/v3/projects/b3ffb8795a9e412dad4876b86abffc02/users/6aef3ec8d95948948b7af2ea0322da9d/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:41.586194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1239/2449] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:14:41.592515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffecd63-58c7-45d8-bc0a-61274f76ddc3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:41.604834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffecd63-58c7-45d8-bc0a-61274f76ddc3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:41.611530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfaad7-6470-4273-acce-0efb13dd00a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:41.612172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e8896-f1ab-474f-a2f7-4aab53bcbf7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ffb8795a9e412dad4876b86abffc02, user_id=6aef3ec8d95948948b7af2ea0322da9d, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:41.612375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfaad7-6470-4273-acce-0efb13dd00a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:41.612772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfaad7-6470-4273-acce-0efb13dd00a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:41.613141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfaad7-6470-4273-acce-0efb13dd00a5 admin admin] PATH_INFO: `/v3/projects/6aa87380d6ee4a70b2fdc35cdcb31ae3/users/96ffc47737804d2f90cc71a61c136d8a/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:41.617815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfaad7-6470-4273-acce-0efb13dd00a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa87380d6ee4a70b2fdc35cdcb31ae3, user_id=96ffc47737804d2f90cc71a61c136d8a, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:41.643633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e8896-f1ab-474f-a2f7-4aab53bcbf7d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:41.650239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfaad7-6470-4273-acce-0efb13dd00a5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:41.819816 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1211/2450] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:41 2022] PUT /identity/v3/projects/b3ffb8795a9e412dad4876b86abffc02/users/6aef3ec8d95948948b7af2ea0322da9d/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:41.829284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1240/2451] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:41 2022] PUT /identity/v3/projects/6aa87380d6ee4a70b2fdc35cdcb31ae3/users/96ffc47737804d2f90cc71a61c136d8a/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:41.832259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684711-94b0-4416-92a5-f98c7adfc3b0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:41.832786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684711-94b0-4416-92a5-f98c7adfc3b0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:41.833063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d684711-94b0-4416-92a5-f98c7adfc3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:41.873873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-6d684711-94b0-4416-92a5-f98c7adfc3b0 None None] MFA Rules not processed for user `6aef3ec8d95948948b7af2ea0322da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:41.875030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6d684711-94b0-4416-92a5-f98c7adfc3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:41.952562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1212/2452] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:41 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:41.962772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfaad7-6470-4273-acce-0efb13dd00a5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:41.967928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f6dfaad7-6470-4273-acce-0efb13dd00a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:42.061909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfaad7-6470-4273-acce-0efb13dd00a5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:42.061909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec425cb-32d0-42b9-b60c-73733d09d7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:42.061909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec425cb-32d0-42b9-b60c-73733d09d7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:42.061909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec425cb-32d0-42b9-b60c-73733d09d7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:42.062353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec425cb-32d0-42b9-b60c-73733d09d7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:42.077060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec425cb-32d0-42b9-b60c-73733d09d7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:42.106886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec425cb-32d0-42b9-b60c-73733d09d7f3 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:42.118270 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1241/2453] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:41 2022] GET /identity/v3/auth/tokens => generated 3680 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:45.190190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684711-94b0-4416-92a5-f98c7adfc3b0 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:45.191774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6d684711-94b0-4416-92a5-f98c7adfc3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:45.288864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d684711-94b0-4416-92a5-f98c7adfc3b0 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:45.293691 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:45.294840 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:45.295505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:45.296007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] PATH_INFO: `/v3/users/8415aa9435a543bbb93756ba5f706152` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:45.297384 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8415aa9435a543bbb93756ba5f706152)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:45.336582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:45.452476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a6cf-e0c4-4ed8-8719-ca116fb71dd5 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:45.453031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a6cf-e0c4-4ed8-8719-ca116fb71dd5 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:45.453154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a6cf-e0c4-4ed8-8719-ca116fb71dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:45.481789 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f658a6cf-e0c4-4ed8-8719-ca116fb71dd5 None None] MFA Rules not processed for user `6aef3ec8d95948948b7af2ea0322da9d`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:45.483030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f658a6cf-e0c4-4ed8-8719-ca116fb71dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:45.495267 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1242/2454] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:45 2022] POST /identity/v3/auth/tokens => generated 3680 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:45.565293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8415aa9435a543bbb93756ba5f706152'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:45.591174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8415aa9435a543bbb93756ba5f706152'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:45.593754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8415aa9435a543bbb93756ba5f706152'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:45.605314 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8415aa9435a543bbb93756ba5f706152'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:45.678048 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8415aa9435a543bbb93756ba5f706152'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:45.685200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1213/2455] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:45 2022] DELETE /identity/v3/users/8415aa9435a543bbb93756ba5f706152 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:46.236717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658a6cf-e0c4-4ed8-8719-ca116fb71dd5 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:46.238514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f658a6cf-e0c4-4ed8-8719-ca116fb71dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:46.342995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658a6cf-e0c4-4ed8-8719-ca116fb71dd5 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:46.426002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:46.426356 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:46.426928 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:46.427285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:46.429322 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:46.442817 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:46.477778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:46.495324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1243/2456] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:46 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:46.527746 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:46.533603 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:46.635195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:46.637262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:46.651978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909d325-2384-45b1-b2ee-809ac6778a73 service placement] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:46.657231 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c88b5-2377-4a2c-aed6-a7d14b2dafc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:46.658159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c88b5-2377-4a2c-aed6-a7d14b2dafc4 service placement] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:46.658451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c88b5-2377-4a2c-aed6-a7d14b2dafc4 service placement] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:46.658966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c88b5-2377-4a2c-aed6-a7d14b2dafc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:46.664538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9bd0bc-ee90-47af-b36e-4189fdd0f4e7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:46.665620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-bb7c88b5-2377-4a2c-aed6-a7d14b2dafc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:46.675065 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:46.675979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:46.676272 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:46.676557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] PATH_INFO: `/v3/projects/232a88acedbc4c3981f4a68cd5572c9e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:46.679010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232a88acedbc4c3981f4a68cd5572c9e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:46.682786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c88b5-2377-4a2c-aed6-a7d14b2dafc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:46.732119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:46.738620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c88b5-2377-4a2c-aed6-a7d14b2dafc4 service placement] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:46.775133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1244/2457] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:46 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:46.996336 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232a88acedbc4c3981f4a68cd5572c9e', 'request_id': 'req-b45cbdc4-38ff-445b-b9ca-3753f04a8258'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:47.142906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232a88acedbc4c3981f4a68cd5572c9e', 'request_id': 'req-b45cbdc4-38ff-445b-b9ca-3753f04a8258'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:47.160859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232a88acedbc4c3981f4a68cd5572c9e', 'request_id': 'req-b45cbdc4-38ff-445b-b9ca-3753f04a8258'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:47.180443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] The token cache is being invalidate because project 232a88acedbc4c3981f4a68cd5572c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:14:47.180971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:47.182049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b45cbdc4-38ff-445b-b9ca-3753f04a8258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:47.184399 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1214/2458] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:14:46 2022] DELETE /identity/v3/projects/232a88acedbc4c3981f4a68cd5572c9e => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:14:47.189990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca7bb-4d77-4d60-a0b1-62221b321872 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:47.190369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca7bb-4d77-4d60-a0b1-62221b321872 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:47.191146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaca7bb-4d77-4d60-a0b1-62221b321872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:47.221147 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-afaca7bb-4d77-4d60-a0b1-62221b321872 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:47.223647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-afaca7bb-4d77-4d60-a0b1-62221b321872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:47.337211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1245/2459] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:47.338247 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75169244-987b-4940-9637-fb391085a671 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:47.338710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75169244-987b-4940-9637-fb391085a671 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:47.339138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75169244-987b-4940-9637-fb391085a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:47.382195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-75169244-987b-4940-9637-fb391085a671 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:47.385754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-75169244-987b-4940-9637-fb391085a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:47.409130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1215/2460] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:47 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:47.412316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaca7bb-4d77-4d60-a0b1-62221b321872 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:47.424199 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaca7bb-4d77-4d60-a0b1-62221b321872 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:47.435644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492fc8-f1e0-47f1-b288-b8fdc0366293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:47.452244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492fc8-f1e0-47f1-b288-b8fdc0366293 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:47.454454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492fc8-f1e0-47f1-b288-b8fdc0366293 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:47.454824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c492fc8-f1e0-47f1-b288-b8fdc0366293 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:47.455703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c492fc8-f1e0-47f1-b288-b8fdc0366293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:14:47.462481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c492fc8-f1e0-47f1-b288-b8fdc0366293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:47.490299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c492fc8-f1e0-47f1-b288-b8fdc0366293 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:47.517973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1246/2461] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:14:47.519403 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75169244-987b-4940-9637-fb391085a671 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:47.536331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75169244-987b-4940-9637-fb391085a671 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:47.542502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd19f-7506-4f2b-bac2-0cb727f23263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:47.543382 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd19f-7506-4f2b-bac2-0cb727f23263 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:47.543815 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd19f-7506-4f2b-bac2-0cb727f23263 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:47.544417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbd19f-7506-4f2b-bac2-0cb727f23263 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:47.545283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd19f-7506-4f2b-bac2-0cb727f23263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:47.578449 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbd19f-7506-4f2b-bac2-0cb727f23263 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:47.714525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1216/2462] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:14:47 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:14:47.718737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492fc8-f1e0-47f1-b288-b8fdc0366293 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:47.730161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c492fc8-f1e0-47f1-b288-b8fdc0366293 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:47.843860 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fca5e0-c78e-4f95-b4b4-44f9cf236566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:47.845296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fca5e0-c78e-4f95-b4b4-44f9cf236566 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:47.845757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fca5e0-c78e-4f95-b4b4-44f9cf236566 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:47.846180 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fca5e0-c78e-4f95-b4b4-44f9cf236566 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:47.847062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fca5e0-c78e-4f95-b4b4-44f9cf236566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:47.876409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fca5e0-c78e-4f95-b4b4-44f9cf236566 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:48.039361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1247/2463] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:14:47 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:14:48.040826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd19f-7506-4f2b-bac2-0cb727f23263 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:48.052752 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbd19f-7506-4f2b-bac2-0cb727f23263 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:48.060305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e86e-2f83-4c75-b732-3d00d3c2ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:48.060305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e86e-2f83-4c75-b732-3d00d3c2ddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:48.060305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e86e-2f83-4c75-b732-3d00d3c2ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:48.060305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35e86e-2f83-4c75-b732-3d00d3c2ddb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:48.060638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35e86e-2f83-4c75-b732-3d00d3c2ddb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:48.096474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35e86e-2f83-4c75-b732-3d00d3c2ddb2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:48.110913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1217/2464] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:14:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:14:48.117459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fca5e0-c78e-4f95-b4b4-44f9cf236566 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:48.140825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fca5e0-c78e-4f95-b4b4-44f9cf236566 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:48.160017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff5190f-e99f-4cfb-b4b8-1d301d82676f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:48.163455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5190f-e99f-4cfb-b4b8-1d301d82676f admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:48.163455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5190f-e99f-4cfb-b4b8-1d301d82676f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:48.163455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff5190f-e99f-4cfb-b4b8-1d301d82676f admin admin] PATH_INFO: `/v3/projects/425eafec10ba482ba63e66192014cc8c/users/1a99a84c43434f52a65e6566abbace2e/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:48.224771 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5190f-e99f-4cfb-b4b8-1d301d82676f admin admin] RBAC: Authorizing `identity:create_grant(project_id=425eafec10ba482ba63e66192014cc8c, user_id=1a99a84c43434f52a65e6566abbace2e, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:48.228894 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e86e-2f83-4c75-b732-3d00d3c2ddb2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:48.231090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9b35e86e-2f83-4c75-b732-3d00d3c2ddb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:48.261013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff5190f-e99f-4cfb-b4b8-1d301d82676f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:48.312635 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35e86e-2f83-4c75-b732-3d00d3c2ddb2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:48.317021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:48.317607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:48.318105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:48.318221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:48.320544 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:48.330370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:48.357870 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:48.368821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1248/2465] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:14:48 2022] PUT /identity/v3/projects/425eafec10ba482ba63e66192014cc8c/users/1a99a84c43434f52a65e6566abbace2e/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:48.375590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1218/2466] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:48 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:48.379365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f27995-bd2f-4e90-ab4c-90191226dce3 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:48.379720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f27995-bd2f-4e90-ab4c-90191226dce3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:48.380068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f27995-bd2f-4e90-ab4c-90191226dce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:48.418526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e9f27995-bd2f-4e90-ab4c-90191226dce3 None None] MFA Rules not processed for user `1a99a84c43434f52a65e6566abbace2e`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:48.419813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e9f27995-bd2f-4e90-ab4c-90191226dce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:48.527828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1249/2467] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:48 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:48.539943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:48.542467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:48.703612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94376593-5e6e-4376-93f1-eb37bf95e643 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:48.819352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605df983-4f91-4f05-849b-d21cee6f8dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:48.820087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605df983-4f91-4f05-849b-d21cee6f8dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:48.820386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605df983-4f91-4f05-849b-d21cee6f8dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:48.820879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605df983-4f91-4f05-849b-d21cee6f8dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:48.836215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605df983-4f91-4f05-849b-d21cee6f8dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:48.880455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605df983-4f91-4f05-849b-d21cee6f8dc7 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:48.902167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1219/2468] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:48 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:49.286647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a38d2-04d8-401a-8a79-33ccf5dd9120 None None] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:49.294971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a38d2-04d8-401a-8a79-33ccf5dd9120 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:49.294971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a38d2-04d8-401a-8a79-33ccf5dd9120 None None] PATH_INFO: `/` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:49.294971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1250/2469] 10.222.0.87 () {54 vars in 921 bytes} [Tue Jan 18 13:14:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:14:49.295397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72497b2a-72fb-4c85-bdd1-5ddb781969c5 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:49.295624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72497b2a-72fb-4c85-bdd1-5ddb781969c5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:49.295909 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72497b2a-72fb-4c85-bdd1-5ddb781969c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:49.336764 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-72497b2a-72fb-4c85-bdd1-5ddb781969c5 None None] MFA Rules not processed for user `cb93a689fc8b4aaab37c8fa4f9a08d64`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:49.352255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-72497b2a-72fb-4c85-bdd1-5ddb781969c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:49.460289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1220/2470] 10.222.0.87 () {58 vars in 1018 bytes} [Tue Jan 18 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:49.461189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a38d2-04d8-401a-8a79-33ccf5dd9120 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:49.473255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a38d2-04d8-401a-8a79-33ccf5dd9120 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:49.479427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976679a6-5532-486b-b7d4-52e91046e00f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:49.491164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976679a6-5532-486b-b7d4-52e91046e00f service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:49.491164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976679a6-5532-486b-b7d4-52e91046e00f service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:49.491164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976679a6-5532-486b-b7d4-52e91046e00f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:49.495726 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976679a6-5532-486b-b7d4-52e91046e00f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:49.526618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976679a6-5532-486b-b7d4-52e91046e00f service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:49.535587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1251/2471] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:49 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:50.709899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba720bb1-ee36-4269-97ad-d73c6aa3921c None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:50.709899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba720bb1-ee36-4269-97ad-d73c6aa3921c None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:50.709899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba720bb1-ee36-4269-97ad-d73c6aa3921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:50.749474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ba720bb1-ee36-4269-97ad-d73c6aa3921c None None] MFA Rules not processed for user `96ffc47737804d2f90cc71a61c136d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:50.750721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ba720bb1-ee36-4269-97ad-d73c6aa3921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:50.830481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1221/2472] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:50 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:50.842904 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976679a6-5532-486b-b7d4-52e91046e00f service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:50.844515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-976679a6-5532-486b-b7d4-52e91046e00f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:50.921541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976679a6-5532-486b-b7d4-52e91046e00f service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:50.925651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aecbdda2f524fbca580d99b3001bed4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:50.925935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:50.926150 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:50.926429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:50.928205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:51.009454 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:51.042637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:51.054036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1252/2473] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:50 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:51.328614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195649e-a251-4508-b097-5170f82a2f38 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:51.328915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195649e-a251-4508-b097-5170f82a2f38 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:51.329198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195649e-a251-4508-b097-5170f82a2f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:51.354471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-d195649e-a251-4508-b097-5170f82a2f38 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:51.355692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d195649e-a251-4508-b097-5170f82a2f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:51.422365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1222/2474] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:14:51 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:51.435244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:51.436841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:51.521602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb9636-52f4-4a0e-a832-c989d0f10a3c service glance] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:51.527162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e30c8a-4bbe-41aa-816d-45831e5b814a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:51.527742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e30c8a-4bbe-41aa-816d-45831e5b814a service swift] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:51.528031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e30c8a-4bbe-41aa-816d-45831e5b814a service swift] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:51.528310 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e30c8a-4bbe-41aa-816d-45831e5b814a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:51.536633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e30c8a-4bbe-41aa-816d-45831e5b814a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:51.561894 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e30c8a-4bbe-41aa-816d-45831e5b814a service swift] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:51.572354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1253/2475] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:14:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:14:54.426743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195649e-a251-4508-b097-5170f82a2f38 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:54.428913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d195649e-a251-4508-b097-5170f82a2f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:54.463975 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e30c8a-4bbe-41aa-816d-45831e5b814a service swift] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:54.476116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e30c8a-4bbe-41aa-816d-45831e5b814a service swift] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:54.484248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4b0e-e052-45b3-baf1-d190f30c908b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:54.484835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4b0e-e052-45b3-baf1-d190f30c908b service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:54.485127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4b0e-e052-45b3-baf1-d190f30c908b service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:54.485455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4b0e-e052-45b3-baf1-d190f30c908b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:54.490450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-de7b4b0e-e052-45b3-baf1-d190f30c908b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:54.561684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195649e-a251-4508-b097-5170f82a2f38 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:54.568939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64e15e-b7c9-4a4d-b8fd-8dafab791b10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:54.569777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64e15e-b7c9-4a4d-b8fd-8dafab791b10 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:54.570294 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64e15e-b7c9-4a4d-b8fd-8dafab791b10 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:54.570880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64e15e-b7c9-4a4d-b8fd-8dafab791b10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:54.573002 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5e64e15e-b7c9-4a4d-b8fd-8dafab791b10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:54.625368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4b0e-e052-45b3-baf1-d190f30c908b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:54.660971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64e15e-b7c9-4a4d-b8fd-8dafab791b10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:54.670415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4b0e-e052-45b3-baf1-d190f30c908b service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:54.683372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1254/2476] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:54 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:14:54.709526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64e15e-b7c9-4a4d-b8fd-8dafab791b10 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:54.733184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1223/2477] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:54 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:56.937717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4b0e-e052-45b3-baf1-d190f30c908b service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:56.950595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4b0e-e052-45b3-baf1-d190f30c908b service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:56.965036 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e62b9-027e-4aae-9269-fff9c8e7875b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:56.967587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e62b9-027e-4aae-9269-fff9c8e7875b service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:56.968037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e62b9-027e-4aae-9269-fff9c8e7875b service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:56.968327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e62b9-027e-4aae-9269-fff9c8e7875b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:56.975464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1c9e62b9-027e-4aae-9269-fff9c8e7875b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:57.021496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e62b9-027e-4aae-9269-fff9c8e7875b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:57.084725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e62b9-027e-4aae-9269-fff9c8e7875b service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:57.106570 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1255/2478] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:56 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:14:58.360363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64e15e-b7c9-4a4d-b8fd-8dafab791b10 service nova] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:58.574599 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64e15e-b7c9-4a4d-b8fd-8dafab791b10 service nova] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:58.579957 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:58.582311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:58.582653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:58.582990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] PATH_INFO: `/v3/users/1a99a84c43434f52a65e6566abbace2e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:58.584323 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a99a84c43434f52a65e6566abbace2e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:58.639125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:58.975154 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a99a84c43434f52a65e6566abbace2e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:59.017981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a99a84c43434f52a65e6566abbace2e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:59.022193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a99a84c43434f52a65e6566abbace2e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:59.054016 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a99a84c43434f52a65e6566abbace2e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:59.175034 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a99a84c43434f52a65e6566abbace2e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:14:59.183420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1224/2479] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:14:58 2022] DELETE /identity/v3/users/1a99a84c43434f52a65e6566abbace2e => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:14:59.187682 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180a224-9d98-4798-b143-4c2026b7b081 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:59.188195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180a224-9d98-4798-b143-4c2026b7b081 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:59.188327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180a224-9d98-4798-b143-4c2026b7b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:59.243374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7180a224-9d98-4798-b143-4c2026b7b081 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:14:59.245176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7180a224-9d98-4798-b143-4c2026b7b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:59.361048 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1256/2480] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:14:59 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:14:59.371568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:14:59.372954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:14:59.516702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba35c7-fe94-4082-a256-aae678bd1861 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:14:59.522163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64215d10-723d-4069-9660-dcd5ba86a4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:14:59.523147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64215d10-723d-4069-9660-dcd5ba86a4ac service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:14:59.523688 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64215d10-723d-4069-9660-dcd5ba86a4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:14:59.524441 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64215d10-723d-4069-9660-dcd5ba86a4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:14:59.542121 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64215d10-723d-4069-9660-dcd5ba86a4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:14:59.580288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64215d10-723d-4069-9660-dcd5ba86a4ac service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:14:59.594575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1225/2481] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:14:59 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:00.444110 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec5f3a-7142-4ce7-a5ab-5a6f1f6cb3a1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:00.444659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec5f3a-7142-4ce7-a5ab-5a6f1f6cb3a1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:00.444659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ec5f3a-7142-4ce7-a5ab-5a6f1f6cb3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:00.495348 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-86ec5f3a-7142-4ce7-a5ab-5a6f1f6cb3a1 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:00.498455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-86ec5f3a-7142-4ce7-a5ab-5a6f1f6cb3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:00.643028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1257/2482] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:15:00 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:00.661950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64215d10-723d-4069-9660-dcd5ba86a4ac service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:00.661950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-64215d10-723d-4069-9660-dcd5ba86a4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:00.826288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64215d10-723d-4069-9660-dcd5ba86a4ac service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:00.837684 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7528f0-0834-49d1-9b5b-c5dfc9f0515b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:00.838570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7528f0-0834-49d1-9b5b-c5dfc9f0515b service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:00.839027 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7528f0-0834-49d1-9b5b-c5dfc9f0515b service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:00.839496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7528f0-0834-49d1-9b5b-c5dfc9f0515b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:00.922239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7528f0-0834-49d1-9b5b-c5dfc9f0515b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:00.980359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec5f3a-7142-4ce7-a5ab-5a6f1f6cb3a1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:00.982114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-86ec5f3a-7142-4ce7-a5ab-5a6f1f6cb3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:00.996161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7528f0-0834-49d1-9b5b-c5dfc9f0515b service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:01.027814 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ec5f3a-7142-4ce7-a5ab-5a6f1f6cb3a1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:01.028070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1226/2483] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:15:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:15:01.047215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:01.048085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:01.053238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:01.053911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] PATH_INFO: `/v3/projects/425eafec10ba482ba63e66192014cc8c` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:01.062402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=425eafec10ba482ba63e66192014cc8c)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:01.160464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:01.459750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '425eafec10ba482ba63e66192014cc8c', 'request_id': 'req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:01.532035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '425eafec10ba482ba63e66192014cc8c', 'request_id': 'req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:01.557032 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '425eafec10ba482ba63e66192014cc8c', 'request_id': 'req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:01.587529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] The token cache is being invalidate because project 425eafec10ba482ba63e66192014cc8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:15:01.588107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:01.601007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-1a5f86d4-b51c-41db-a7e6-7d4d4c4aba92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:01.610380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1258/2484] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:15:00 2022] DELETE /identity/v3/projects/425eafec10ba482ba63e66192014cc8c => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:01.617076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8486-b88c-4ef2-bbeb-cbd1dad24b84 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:01.621787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8486-b88c-4ef2-bbeb-cbd1dad24b84 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:01.621787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8486-b88c-4ef2-bbeb-cbd1dad24b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:01.656045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-292e8486-b88c-4ef2-bbeb-cbd1dad24b84 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:01.657469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-292e8486-b88c-4ef2-bbeb-cbd1dad24b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:01.869488 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1227/2485] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:01.875223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c7d22-d3af-42c3-9bb0-f071aeba8757 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:01.875868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c7d22-d3af-42c3-9bb0-f071aeba8757 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:01.876309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c7d22-d3af-42c3-9bb0-f071aeba8757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:01.934410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d03c7d22-d3af-42c3-9bb0-f071aeba8757 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:01.935905 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d03c7d22-d3af-42c3-9bb0-f071aeba8757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:01.948725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1259/2486] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:01.954767 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e8486-b88c-4ef2-bbeb-cbd1dad24b84 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:01.970498 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e8486-b88c-4ef2-bbeb-cbd1dad24b84 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:01.984886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1542-7c7c-48c2-afb3-f44f38f81e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:01.985944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1542-7c7c-48c2-afb3-f44f38f81e94 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:01.986859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1542-7c7c-48c2-afb3-f44f38f81e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:01.987948 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f1542-7c7c-48c2-afb3-f44f38f81e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:01.990725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f1542-7c7c-48c2-afb3-f44f38f81e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:15:01.994224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f1542-7c7c-48c2-afb3-f44f38f81e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:02.088694 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f1542-7c7c-48c2-afb3-f44f38f81e94 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:02.168503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1228/2487] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:15:02.193090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c7d22-d3af-42c3-9bb0-f071aeba8757 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:02.224498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c7d22-d3af-42c3-9bb0-f071aeba8757 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:02.240035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db01b33-51dc-4921-96d7-e13fe4d337cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:02.241101 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db01b33-51dc-4921-96d7-e13fe4d337cf admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:02.245617 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db01b33-51dc-4921-96d7-e13fe4d337cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:02.281023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db01b33-51dc-4921-96d7-e13fe4d337cf admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:02.281023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db01b33-51dc-4921-96d7-e13fe4d337cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:02.365717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db01b33-51dc-4921-96d7-e13fe4d337cf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:03.166056 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1260/2488] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:15:02 2022] POST /identity/v3/projects => generated 371 bytes in 974 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:15:03.169784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1542-7c7c-48c2-afb3-f44f38f81e94 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:03.209076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f1542-7c7c-48c2-afb3-f44f38f81e94 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:03.274153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af292b-a515-4ab5-872c-be014cd293b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:03.274778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af292b-a515-4ab5-872c-be014cd293b3 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:03.275066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af292b-a515-4ab5-872c-be014cd293b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:03.275377 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af292b-a515-4ab5-872c-be014cd293b3 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:03.276016 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af292b-a515-4ab5-872c-be014cd293b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:03.303103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af292b-a515-4ab5-872c-be014cd293b3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:03.490167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1229/2489] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:15:03 2022] POST /identity/v3/users => generated 286 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:15:03.494330 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db01b33-51dc-4921-96d7-e13fe4d337cf admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:03.512942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db01b33-51dc-4921-96d7-e13fe4d337cf admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:03.541711 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b2210-b365-4783-9ad0-cf7d93642fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:03.542331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2210-b365-4783-9ad0-cf7d93642fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:03.542621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2210-b365-4783-9ad0-cf7d93642fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:03.542900 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b2210-b365-4783-9ad0-cf7d93642fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:03.543632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b2210-b365-4783-9ad0-cf7d93642fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:03.579271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b2210-b365-4783-9ad0-cf7d93642fc0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:03.602304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1261/2490] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:15:03.607179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af292b-a515-4ab5-872c-be014cd293b3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:03.622596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af292b-a515-4ab5-872c-be014cd293b3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:03.630084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c3d24-e2bc-4c81-bf83-8f5b668fae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:03.631787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c3d24-e2bc-4c81-bf83-8f5b668fae55 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:03.632182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c3d24-e2bc-4c81-bf83-8f5b668fae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:03.632599 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c3d24-e2bc-4c81-bf83-8f5b668fae55 admin admin] PATH_INFO: `/v3/projects/a6d89fabbc7846d085238df444fad0b4/users/9f12b831343e44dbbf2d4f00c2f16bdb/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:03.721239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c3d24-e2bc-4c81-bf83-8f5b668fae55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d89fabbc7846d085238df444fad0b4, user_id=9f12b831343e44dbbf2d4f00c2f16bdb, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:03.816812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c3d24-e2bc-4c81-bf83-8f5b668fae55 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:03.949385 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1230/2491] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:15:03 2022] PUT /identity/v3/projects/a6d89fabbc7846d085238df444fad0b4/users/9f12b831343e44dbbf2d4f00c2f16bdb/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:15:03.960284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af256b-dfb4-44cb-b3b0-ec99dd76e059 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:03.960594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af256b-dfb4-44cb-b3b0-ec99dd76e059 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:03.960835 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af256b-dfb4-44cb-b3b0-ec99dd76e059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:04.087380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c5af256b-dfb4-44cb-b3b0-ec99dd76e059 None None] MFA Rules not processed for user `9f12b831343e44dbbf2d4f00c2f16bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:04.088784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c5af256b-dfb4-44cb-b3b0-ec99dd76e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:04.280647 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1262/2492] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:03 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:04.290732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c3d24-e2bc-4c81-bf83-8f5b668fae55 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:04.293404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ba1c3d24-e2bc-4c81-bf83-8f5b668fae55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:04.429493 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c3d24-e2bc-4c81-bf83-8f5b668fae55 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:04.443370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68294ba3-b8f8-4d8f-95be-fcde80752ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:04.443370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68294ba3-b8f8-4d8f-95be-fcde80752ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:04.443370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68294ba3-b8f8-4d8f-95be-fcde80752ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:04.443370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68294ba3-b8f8-4d8f-95be-fcde80752ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:04.455963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68294ba3-b8f8-4d8f-95be-fcde80752ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:04.486718 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68294ba3-b8f8-4d8f-95be-fcde80752ca3 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:04.506031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1231/2493] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:04 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:15:04.547293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af256b-dfb4-44cb-b3b0-ec99dd76e059 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:04.667361 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5af256b-dfb4-44cb-b3b0-ec99dd76e059 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:04.677959 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:04.678949 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:04.679082 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:04.679671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] PATH_INFO: `/v3/users/9f12b831343e44dbbf2d4f00c2f16bdb` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:04.680791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f12b831343e44dbbf2d4f00c2f16bdb)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:04.727642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:05.000989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f12b831343e44dbbf2d4f00c2f16bdb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:05.001577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f12b831343e44dbbf2d4f00c2f16bdb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:05.012367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f12b831343e44dbbf2d4f00c2f16bdb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:05.031578 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f12b831343e44dbbf2d4f00c2f16bdb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:05.095194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f12b831343e44dbbf2d4f00c2f16bdb'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:05.113299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1263/2494] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:15:04 2022] DELETE /identity/v3/users/9f12b831343e44dbbf2d4f00c2f16bdb => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:05.119474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427298cc-61a4-4546-b5d7-ad96fcfe406b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:05.119474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427298cc-61a4-4546-b5d7-ad96fcfe406b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:05.119474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427298cc-61a4-4546-b5d7-ad96fcfe406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:05.162783 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-427298cc-61a4-4546-b5d7-ad96fcfe406b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:05.164276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-427298cc-61a4-4546-b5d7-ad96fcfe406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:05.278518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1232/2495] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:05 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:05.286495 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:05.288532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:05.444159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7848a-ffff-4f47-a083-778bdf297b03 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:05.537973 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169a0ed-8ec8-44eb-8efc-dc011b600f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:05.538717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169a0ed-8ec8-44eb-8efc-dc011b600f32 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:05.539188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169a0ed-8ec8-44eb-8efc-dc011b600f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:05.541084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169a0ed-8ec8-44eb-8efc-dc011b600f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:05.572196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169a0ed-8ec8-44eb-8efc-dc011b600f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:05.654316 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169a0ed-8ec8-44eb-8efc-dc011b600f32 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:05.694451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1264/2496] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:05 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:06.911993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427298cc-61a4-4546-b5d7-ad96fcfe406b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:06.917399 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-427298cc-61a4-4546-b5d7-ad96fcfe406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:06.941404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427298cc-61a4-4546-b5d7-ad96fcfe406b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:06.947141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:06.948690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:06.949198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:06.949658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] PATH_INFO: `/v3/projects/a6d89fabbc7846d085238df444fad0b4` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:06.951176 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d89fabbc7846d085238df444fad0b4)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:06.986595 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:07.339407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d89fabbc7846d085238df444fad0b4', 'request_id': 'req-7ec04696-2266-4f1a-af2e-f809d846745d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:07.491539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d89fabbc7846d085238df444fad0b4', 'request_id': 'req-7ec04696-2266-4f1a-af2e-f809d846745d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:07.507548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d89fabbc7846d085238df444fad0b4', 'request_id': 'req-7ec04696-2266-4f1a-af2e-f809d846745d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:07.527545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] The token cache is being invalidate because project a6d89fabbc7846d085238df444fad0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:15:07.528172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:07.529417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7ec04696-2266-4f1a-af2e-f809d846745d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:07.540169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d151c-4572-4ddf-9087-66316cb3e466 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:07.540792 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d151c-4572-4ddf-9087-66316cb3e466 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:07.541046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d151c-4572-4ddf-9087-66316cb3e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:07.541797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1233/2497] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:15:06 2022] DELETE /identity/v3/projects/a6d89fabbc7846d085238df444fad0b4 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:07.586430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-2d6d151c-4572-4ddf-9087-66316cb3e466 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:07.587887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2d6d151c-4572-4ddf-9087-66316cb3e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:07.732053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1265/2498] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:07.740878 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d678252-967e-424f-8c79-4756ea1329b2 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:07.741496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d678252-967e-424f-8c79-4756ea1329b2 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:07.742165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d678252-967e-424f-8c79-4756ea1329b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:07.770481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1d678252-967e-424f-8c79-4756ea1329b2 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:07.771699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1d678252-967e-424f-8c79-4756ea1329b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:07.782741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1234/2499] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:07 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:07.785403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d151c-4572-4ddf-9087-66316cb3e466 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:07.798934 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d151c-4572-4ddf-9087-66316cb3e466 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:07.810836 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f37d2-422a-4c22-9ff3-7227adde7687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:07.811526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f37d2-422a-4c22-9ff3-7227adde7687 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:07.811813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f37d2-422a-4c22-9ff3-7227adde7687 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:07.812094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f37d2-422a-4c22-9ff3-7227adde7687 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:07.812787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f37d2-422a-4c22-9ff3-7227adde7687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:15:07.813083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f37d2-422a-4c22-9ff3-7227adde7687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:07.850109 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f37d2-422a-4c22-9ff3-7227adde7687 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:07.880123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1266/2500] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:15:07.881283 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d678252-967e-424f-8c79-4756ea1329b2 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:07.893085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d678252-967e-424f-8c79-4756ea1329b2 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:07.907666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b256e-bcde-4dbf-bcc4-1be8252a1294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:07.908284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b256e-bcde-4dbf-bcc4-1be8252a1294 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:07.909108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b256e-bcde-4dbf-bcc4-1be8252a1294 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:07.909422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b256e-bcde-4dbf-bcc4-1be8252a1294 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:07.910822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b256e-bcde-4dbf-bcc4-1be8252a1294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:07.954105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b256e-bcde-4dbf-bcc4-1be8252a1294 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:08.071765 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1235/2501] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:15:07 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:15:08.076091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f37d2-422a-4c22-9ff3-7227adde7687 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:08.095003 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f37d2-422a-4c22-9ff3-7227adde7687 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:08.192389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079044-cad4-4553-ad36-5e584871d26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:08.193233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079044-cad4-4553-ad36-5e584871d26c admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:08.193595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079044-cad4-4553-ad36-5e584871d26c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:08.193936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74079044-cad4-4553-ad36-5e584871d26c admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:08.194630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74079044-cad4-4553-ad36-5e584871d26c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:08.221824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74079044-cad4-4553-ad36-5e584871d26c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:08.312984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1267/2502] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:15:08 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:15:08.316477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b256e-bcde-4dbf-bcc4-1be8252a1294 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:08.327749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b256e-bcde-4dbf-bcc4-1be8252a1294 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:08.333222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e406e48-5a4c-426e-b3da-d96288a6a9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:08.333838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e406e48-5a4c-426e-b3da-d96288a6a9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:08.334127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e406e48-5a4c-426e-b3da-d96288a6a9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:08.334411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e406e48-5a4c-426e-b3da-d96288a6a9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:08.335118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e406e48-5a4c-426e-b3da-d96288a6a9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:08.362369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e406e48-5a4c-426e-b3da-d96288a6a9b1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:08.375054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1236/2503] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:15:08.378506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079044-cad4-4553-ad36-5e584871d26c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:08.389424 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74079044-cad4-4553-ad36-5e584871d26c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:08.394610 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878d4df-2016-42e3-971c-771e9b7fc9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:08.395476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d4df-2016-42e3-971c-771e9b7fc9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:08.396077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d4df-2016-42e3-971c-771e9b7fc9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:08.396077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878d4df-2016-42e3-971c-771e9b7fc9eb admin admin] PATH_INFO: `/v3/projects/a0cf2555372d4833a1b2cbdd625d2186/users/a3dd76d6bced43f696d43e9f559e854e/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:08.419300 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878d4df-2016-42e3-971c-771e9b7fc9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0cf2555372d4833a1b2cbdd625d2186, user_id=a3dd76d6bced43f696d43e9f559e854e, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:08.446926 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a878d4df-2016-42e3-971c-771e9b7fc9eb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:08.512195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1268/2504] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:15:08 2022] PUT /identity/v3/projects/a0cf2555372d4833a1b2cbdd625d2186/users/a3dd76d6bced43f696d43e9f559e854e/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:08.517398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb920040-a6bd-42f0-afe6-4baac14f76fc None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:08.517698 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb920040-a6bd-42f0-afe6-4baac14f76fc None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:08.518503 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb920040-a6bd-42f0-afe6-4baac14f76fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:08.543814 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-fb920040-a6bd-42f0-afe6-4baac14f76fc None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:08.545189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-fb920040-a6bd-42f0-afe6-4baac14f76fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:08.679817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1237/2505] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:08 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:08.687801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878d4df-2016-42e3-971c-771e9b7fc9eb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:08.692736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a878d4df-2016-42e3-971c-771e9b7fc9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:08.831670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a878d4df-2016-42e3-971c-771e9b7fc9eb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:08.835763 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f3554-ad10-4aa3-aac5-9061c121df2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:08.836774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f3554-ad10-4aa3-aac5-9061c121df2d service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:08.837284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f3554-ad10-4aa3-aac5-9061c121df2d service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:08.837765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f3554-ad10-4aa3-aac5-9061c121df2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:08.854492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f3554-ad10-4aa3-aac5-9061c121df2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:08.891251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f3554-ad10-4aa3-aac5-9061c121df2d service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:08.907094 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1269/2506] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:08 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:09.572448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f072c-491c-4617-9463-197175953256 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:09.572950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f072c-491c-4617-9463-197175953256 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:09.573045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f072c-491c-4617-9463-197175953256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:09.596879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-763f072c-491c-4617-9463-197175953256 None None] MFA Rules not processed for user `1d5d20d1cfd543d989cd803c592d4ca3`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:09.598049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-763f072c-491c-4617-9463-197175953256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:09.661072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1238/2507] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:09 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:10.104412 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f3554-ad10-4aa3-aac5-9061c121df2d service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:10.113664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f3554-ad10-4aa3-aac5-9061c121df2d service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:10.117018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9a3fa-9d62-4c48-93c5-b59b3b7c4ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:10.117582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9a3fa-9d62-4c48-93c5-b59b3b7c4ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:10.117870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9a3fa-9d62-4c48-93c5-b59b3b7c4ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:10.118146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9a3fa-9d62-4c48-93c5-b59b3b7c4ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:10.119940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b9c9a3fa-9d62-4c48-93c5-b59b3b7c4ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:10.131001 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9a3fa-9d62-4c48-93c5-b59b3b7c4ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:10.157595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c9a3fa-9d62-4c48-93c5-b59b3b7c4ba4 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:10.166862 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1270/2508] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:10 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:18.643588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77ed2c-9cfc-418a-b56c-ff2c67e1b3b9 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:18.644285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77ed2c-9cfc-418a-b56c-ff2c67e1b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:18.644285 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77ed2c-9cfc-418a-b56c-ff2c67e1b3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:18.680502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1b77ed2c-9cfc-418a-b56c-ff2c67e1b3b9 None None] MFA Rules not processed for user `a3dd76d6bced43f696d43e9f559e854e`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:18.681763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1b77ed2c-9cfc-418a-b56c-ff2c67e1b3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:18.755934 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1239/2509] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:18 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:18.760374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9a3fa-9d62-4c48-93c5-b59b3b7c4ba4 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:18.771152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9a3fa-9d62-4c48-93c5-b59b3b7c4ba4 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:18.775573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605a93b-8315-4cb9-9c6c-79b2333b4d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:18.776148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605a93b-8315-4cb9-9c6c-79b2333b4d0c admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:18.776437 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605a93b-8315-4cb9-9c6c-79b2333b4d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:18.776715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605a93b-8315-4cb9-9c6c-79b2333b4d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:18.777336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605a93b-8315-4cb9-9c6c-79b2333b4d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:18.804416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605a93b-8315-4cb9-9c6c-79b2333b4d0c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:18.904811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1271/2510] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:15:18 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:15:18.909683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77ed2c-9cfc-418a-b56c-ff2c67e1b3b9 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:18.920051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77ed2c-9cfc-418a-b56c-ff2c67e1b3b9 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:18.988047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3699cb7-f9d6-438c-8740-bdf2028e61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:18.988650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3699cb7-f9d6-438c-8740-bdf2028e61f4 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:18.988941 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3699cb7-f9d6-438c-8740-bdf2028e61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:18.989223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3699cb7-f9d6-438c-8740-bdf2028e61f4 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:18.989872 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3699cb7-f9d6-438c-8740-bdf2028e61f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:19.017526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3699cb7-f9d6-438c-8740-bdf2028e61f4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:19.132439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1240/2511] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:15:18 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:15:19.133889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605a93b-8315-4cb9-9c6c-79b2333b4d0c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:19.143764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605a93b-8315-4cb9-9c6c-79b2333b4d0c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:19.148048 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66976abb-d643-4afd-abd1-e7448ae148d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:19.149130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66976abb-d643-4afd-abd1-e7448ae148d0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:19.149326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66976abb-d643-4afd-abd1-e7448ae148d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:19.149607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66976abb-d643-4afd-abd1-e7448ae148d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:19.150295 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66976abb-d643-4afd-abd1-e7448ae148d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:19.176964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66976abb-d643-4afd-abd1-e7448ae148d0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:19.187761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1272/2512] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:15:19.192039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3699cb7-f9d6-438c-8740-bdf2028e61f4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:19.202535 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3699cb7-f9d6-438c-8740-bdf2028e61f4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:19.207046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a52e3-7490-4538-af4e-5721d46d7572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:19.207902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a52e3-7490-4538-af4e-5721d46d7572 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:19.208191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a52e3-7490-4538-af4e-5721d46d7572 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:19.208479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34a52e3-7490-4538-af4e-5721d46d7572 admin admin] PATH_INFO: `/v3/projects/c5d34056ac47431ea8f999da61b3fe87/users/6e842d84327242988b38f13a9a4ac51d/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:19.230976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a52e3-7490-4538-af4e-5721d46d7572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d34056ac47431ea8f999da61b3fe87, user_id=6e842d84327242988b38f13a9a4ac51d, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:19.259578 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34a52e3-7490-4538-af4e-5721d46d7572 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:19.369883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1241/2513] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:15:19 2022] PUT /identity/v3/projects/c5d34056ac47431ea8f999da61b3fe87/users/6e842d84327242988b38f13a9a4ac51d/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:19.371085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66976abb-d643-4afd-abd1-e7448ae148d0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:19.394663 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66976abb-d643-4afd-abd1-e7448ae148d0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:19.571174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669d5f4-d55f-4eae-b3e6-3f7f3c746d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:19.571992 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669d5f4-d55f-4eae-b3e6-3f7f3c746d77 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:19.572368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669d5f4-d55f-4eae-b3e6-3f7f3c746d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:19.572750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669d5f4-d55f-4eae-b3e6-3f7f3c746d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:19.573883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669d5f4-d55f-4eae-b3e6-3f7f3c746d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:19.607895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669d5f4-d55f-4eae-b3e6-3f7f3c746d77 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:19.621515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1273/2514] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:15:19.626245 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a52e3-7490-4538-af4e-5721d46d7572 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:19.637301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34a52e3-7490-4538-af4e-5721d46d7572 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:19.643558 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64865-67d8-4f44-8f3b-8d58a4e3b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:19.644721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64865-67d8-4f44-8f3b-8d58a4e3b6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:19.645631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64865-67d8-4f44-8f3b-8d58a4e3b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:19.646709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce64865-67d8-4f44-8f3b-8d58a4e3b6c3 admin admin] PATH_INFO: `/v3/projects/c5d34056ac47431ea8f999da61b3fe87/users/6e842d84327242988b38f13a9a4ac51d/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:19.649078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce64865-67d8-4f44-8f3b-8d58a4e3b6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d34056ac47431ea8f999da61b3fe87, user_id=6e842d84327242988b38f13a9a4ac51d, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:19.660462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669d5f4-d55f-4eae-b3e6-3f7f3c746d77 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:19.662232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7669d5f4-d55f-4eae-b3e6-3f7f3c746d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:19.675030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669d5f4-d55f-4eae-b3e6-3f7f3c746d77 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:19.676733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce64865-67d8-4f44-8f3b-8d58a4e3b6c3 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:19.680940 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:19.681997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:19.682311 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:19.682659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] PATH_INFO: `/v3/users/d893914e233748aaa15e357f305a7587` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:19.684420 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d893914e233748aaa15e357f305a7587)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:19.688321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1242/2515] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:15:19 2022] PUT /identity/v3/projects/c5d34056ac47431ea8f999da61b3fe87/users/6e842d84327242988b38f13a9a4ac51d/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:19.692629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64865-67d8-4f44-8f3b-8d58a4e3b6c3 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:19.713600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:19.797077 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce64865-67d8-4f44-8f3b-8d58a4e3b6c3 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:19.805844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84945877-8e1f-4d23-9c17-b029a4cb1dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:19.806836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84945877-8e1f-4d23-9c17-b029a4cb1dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:19.807878 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84945877-8e1f-4d23-9c17-b029a4cb1dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:19.807878 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84945877-8e1f-4d23-9c17-b029a4cb1dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:19.808412 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84945877-8e1f-4d23-9c17-b029a4cb1dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:19.839715 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84945877-8e1f-4d23-9c17-b029a4cb1dc7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:19.855342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1243/2516] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:15:19.859337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84945877-8e1f-4d23-9c17-b029a4cb1dc7 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:19.869933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84945877-8e1f-4d23-9c17-b029a4cb1dc7 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:19.874709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b97d6f-5ffd-48e7-9ab8-8048df42e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:19.875624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b97d6f-5ffd-48e7-9ab8-8048df42e6f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:19.875911 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b97d6f-5ffd-48e7-9ab8-8048df42e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:19.876233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b97d6f-5ffd-48e7-9ab8-8048df42e6f9 admin admin] PATH_INFO: `/v3/projects/c5d34056ac47431ea8f999da61b3fe87/users/6e842d84327242988b38f13a9a4ac51d/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:19.878803 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b97d6f-5ffd-48e7-9ab8-8048df42e6f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d34056ac47431ea8f999da61b3fe87, user_id=6e842d84327242988b38f13a9a4ac51d, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:19.906770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b97d6f-5ffd-48e7-9ab8-8048df42e6f9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:19.975732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd893914e233748aaa15e357f305a7587'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:19.988342 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd893914e233748aaa15e357f305a7587'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:19.999828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd893914e233748aaa15e357f305a7587'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:20.020974 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd893914e233748aaa15e357f305a7587'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:20.025502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1244/2517] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:15:19 2022] PUT /identity/v3/projects/c5d34056ac47431ea8f999da61b3fe87/users/6e842d84327242988b38f13a9a4ac51d/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:15:20.105520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd893914e233748aaa15e357f305a7587'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:20.110672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1274/2518] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:15:19 2022] DELETE /identity/v3/users/d893914e233748aaa15e357f305a7587 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:20.116055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2246f5-1411-454f-97b9-48fee0b673e0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:20.116360 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2246f5-1411-454f-97b9-48fee0b673e0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:20.116646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2246f5-1411-454f-97b9-48fee0b673e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:20.141576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-8b2246f5-1411-454f-97b9-48fee0b673e0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:20.143963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8b2246f5-1411-454f-97b9-48fee0b673e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:20.216922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1245/2519] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:20 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:20.243215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:20.244872 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:20.365330 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00a783-0bd3-444d-93df-eba8898d5bfb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:20.368732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5e41-2ba1-48bf-a1da-1e0d291462b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:20.369306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5e41-2ba1-48bf-a1da-1e0d291462b8 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:20.369646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5e41-2ba1-48bf-a1da-1e0d291462b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:20.369903 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d5e41-2ba1-48bf-a1da-1e0d291462b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:20.380203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d5e41-2ba1-48bf-a1da-1e0d291462b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:20.409651 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d5e41-2ba1-48bf-a1da-1e0d291462b8 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:20.421924 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1275/2520] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:20 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:20.430321 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8682d2-b3d7-4901-8b85-0cdb9c7c026e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:20.432460 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8682d2-b3d7-4901-8b85-0cdb9c7c026e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:20.432460 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8682d2-b3d7-4901-8b85-0cdb9c7c026e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:20.453795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-8d8682d2-b3d7-4901-8b85-0cdb9c7c026e None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:20.455510 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8d8682d2-b3d7-4901-8b85-0cdb9c7c026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:20.523185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1246/2521] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:15:20 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:20.537458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5e41-2ba1-48bf-a1da-1e0d291462b8 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:20.543473 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-531d5e41-2ba1-48bf-a1da-1e0d291462b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:20.620489 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d5e41-2ba1-48bf-a1da-1e0d291462b8 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:20.625269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb799a14-61c0-44d5-90fd-044d2b3fa973 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:20.625866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799a14-61c0-44d5-90fd-044d2b3fa973 service swift] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:20.626156 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799a14-61c0-44d5-90fd-044d2b3fa973 service swift] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:20.626440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb799a14-61c0-44d5-90fd-044d2b3fa973 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:20.635464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb799a14-61c0-44d5-90fd-044d2b3fa973 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:20.664142 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb799a14-61c0-44d5-90fd-044d2b3fa973 service swift] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:20.673586 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1276/2522] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:15:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:15:21.469479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8682d2-b3d7-4901-8b85-0cdb9c7c026e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:21.471606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8d8682d2-b3d7-4901-8b85-0cdb9c7c026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:21.506676 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8682d2-b3d7-4901-8b85-0cdb9c7c026e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:21.524231 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:21.525853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:21.526466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:21.527185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] PATH_INFO: `/v3/projects/84a0be2dd4d74d14872cf739718e32c6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:21.532310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a0be2dd4d74d14872cf739718e32c6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:21.614442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:21.914874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a0be2dd4d74d14872cf739718e32c6', 'request_id': 'req-322959b7-26e4-440d-8c11-d1aea6ae384f'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:22.031141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a0be2dd4d74d14872cf739718e32c6', 'request_id': 'req-322959b7-26e4-440d-8c11-d1aea6ae384f'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:22.045419 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a0be2dd4d74d14872cf739718e32c6', 'request_id': 'req-322959b7-26e4-440d-8c11-d1aea6ae384f'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:22.070949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] The token cache is being invalidate because project 84a0be2dd4d74d14872cf739718e32c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:15:22.071469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:22.072393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-322959b7-26e4-440d-8c11-d1aea6ae384f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:22.074351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1247/2523] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:15:21 2022] DELETE /identity/v3/projects/84a0be2dd4d74d14872cf739718e32c6 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:22.082074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98622122-dbfe-483d-97c6-147e55166f14 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:22.083121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98622122-dbfe-483d-97c6-147e55166f14 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:22.083595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98622122-dbfe-483d-97c6-147e55166f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:22.131925 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-98622122-dbfe-483d-97c6-147e55166f14 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:22.140675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-98622122-dbfe-483d-97c6-147e55166f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:22.306318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1277/2524] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:22.316262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4013c4-c8af-4c0e-9caf-94a048351225 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:22.316924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4013c4-c8af-4c0e-9caf-94a048351225 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:22.317370 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4013c4-c8af-4c0e-9caf-94a048351225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:22.344045 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-6c4013c4-c8af-4c0e-9caf-94a048351225 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:22.345463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6c4013c4-c8af-4c0e-9caf-94a048351225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:22.359361 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1248/2525] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:22 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:22.366176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98622122-dbfe-483d-97c6-147e55166f14 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:22.378423 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98622122-dbfe-483d-97c6-147e55166f14 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:22.385767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0657a7e-4fa8-4d48-acbd-49e9a3250006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:22.386595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0657a7e-4fa8-4d48-acbd-49e9a3250006 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:22.387165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0657a7e-4fa8-4d48-acbd-49e9a3250006 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:22.387701 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0657a7e-4fa8-4d48-acbd-49e9a3250006 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:22.389913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0657a7e-4fa8-4d48-acbd-49e9a3250006 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:15:22.390283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0657a7e-4fa8-4d48-acbd-49e9a3250006 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:22.457546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0657a7e-4fa8-4d48-acbd-49e9a3250006 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:22.478490 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1278/2526] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:15:22.484621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4013c4-c8af-4c0e-9caf-94a048351225 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:22.494515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4013c4-c8af-4c0e-9caf-94a048351225 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:22.499742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163188-31e2-4d9c-8c8a-7b705c411831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:22.500702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163188-31e2-4d9c-8c8a-7b705c411831 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:22.501230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163188-31e2-4d9c-8c8a-7b705c411831 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:22.501822 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1163188-31e2-4d9c-8c8a-7b705c411831 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:22.502914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163188-31e2-4d9c-8c8a-7b705c411831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:22.532191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1163188-31e2-4d9c-8c8a-7b705c411831 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:22.651162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1249/2527] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:15:22 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:15:22.655561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0657a7e-4fa8-4d48-acbd-49e9a3250006 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:22.670679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0657a7e-4fa8-4d48-acbd-49e9a3250006 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:22.789219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf62090-c2a4-4b00-b58f-7eadae8e2a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:22.789790 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf62090-c2a4-4b00-b58f-7eadae8e2a82 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:22.790137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf62090-c2a4-4b00-b58f-7eadae8e2a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:22.790427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf62090-c2a4-4b00-b58f-7eadae8e2a82 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:22.791105 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf62090-c2a4-4b00-b58f-7eadae8e2a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:22.831259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf62090-c2a4-4b00-b58f-7eadae8e2a82 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:22.972574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1279/2528] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:15:22 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:15:22.976823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163188-31e2-4d9c-8c8a-7b705c411831 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:22.993362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1163188-31e2-4d9c-8c8a-7b705c411831 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:23.007864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e33f628-8219-4e77-b32a-a23df22bcca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:23.013429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33f628-8219-4e77-b32a-a23df22bcca4 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:23.020159 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33f628-8219-4e77-b32a-a23df22bcca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:23.021139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e33f628-8219-4e77-b32a-a23df22bcca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:23.023383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33f628-8219-4e77-b32a-a23df22bcca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:23.133250 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e33f628-8219-4e77-b32a-a23df22bcca4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:23.178293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1250/2529] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:15:23.182407 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf62090-c2a4-4b00-b58f-7eadae8e2a82 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:23.196236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf62090-c2a4-4b00-b58f-7eadae8e2a82 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:23.205366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b5a9-2eb8-4475-bfb3-c2b3ede88e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:23.206216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b5a9-2eb8-4475-bfb3-c2b3ede88e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:23.206504 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b5a9-2eb8-4475-bfb3-c2b3ede88e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:23.206787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979b5a9-2eb8-4475-bfb3-c2b3ede88e91 admin admin] PATH_INFO: `/v3/projects/de8f9a34366c4d849fd444dad0ab8ce0/users/41d2533b3705474b8d08d50a5e87ad77/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:23.277268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979b5a9-2eb8-4475-bfb3-c2b3ede88e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8f9a34366c4d849fd444dad0ab8ce0, user_id=41d2533b3705474b8d08d50a5e87ad77, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:23.319117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979b5a9-2eb8-4475-bfb3-c2b3ede88e91 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:23.829720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1280/2530] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:15:23 2022] PUT /identity/v3/projects/de8f9a34366c4d849fd444dad0ab8ce0/users/41d2533b3705474b8d08d50a5e87ad77/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:23.831849 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d45a2-4f6a-4548-858a-73e3ae771c51 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:23.832433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d45a2-4f6a-4548-858a-73e3ae771c51 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:23.832633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d45a2-4f6a-4548-858a-73e3ae771c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:23.952227 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-5f0d45a2-4f6a-4548-858a-73e3ae771c51 None None] MFA Rules not processed for user `41d2533b3705474b8d08d50a5e87ad77`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:23.953900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5f0d45a2-4f6a-4548-858a-73e3ae771c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:24.281262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1251/2531] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:23 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:24.292934 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b5a9-2eb8-4475-bfb3-c2b3ede88e91 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:24.296989 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5979b5a9-2eb8-4475-bfb3-c2b3ede88e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:24.407480 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979b5a9-2eb8-4475-bfb3-c2b3ede88e91 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:24.413311 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76272f8-a445-45ab-b0e9-72c02c6537e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:24.414515 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76272f8-a445-45ab-b0e9-72c02c6537e5 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:24.414793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76272f8-a445-45ab-b0e9-72c02c6537e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:24.415099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76272f8-a445-45ab-b0e9-72c02c6537e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:24.427372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76272f8-a445-45ab-b0e9-72c02c6537e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:24.465022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76272f8-a445-45ab-b0e9-72c02c6537e5 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:24.482690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1281/2532] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:24 2022] GET /identity/v3/auth/tokens => generated 3672 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:24.811198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d45a2-4f6a-4548-858a-73e3ae771c51 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:24.812686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5f0d45a2-4f6a-4548-858a-73e3ae771c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:25.062858 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d45a2-4f6a-4548-858a-73e3ae771c51 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:25.079650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b7f22b-b744-44e1-b2a3-10b691bb755d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:25.090582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7f22b-b744-44e1-b2a3-10b691bb755d service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:25.090582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7f22b-b744-44e1-b2a3-10b691bb755d service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:25.090582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7f22b-b744-44e1-b2a3-10b691bb755d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:25.091833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d8b7f22b-b744-44e1-b2a3-10b691bb755d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:25.134933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7f22b-b744-44e1-b2a3-10b691bb755d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:25.170823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b7f22b-b744-44e1-b2a3-10b691bb755d service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:25.185266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1252/2533] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:24 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:33.639336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76272f8-a445-45ab-b0e9-72c02c6537e5 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:33.641478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c76272f8-a445-45ab-b0e9-72c02c6537e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:33.671340 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76272f8-a445-45ab-b0e9-72c02c6537e5 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:33.686922 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c1494-159b-4b5f-ac22-a08458bfc94d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:33.687691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c1494-159b-4b5f-ac22-a08458bfc94d service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:33.688232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c1494-159b-4b5f-ac22-a08458bfc94d service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:33.688615 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c1494-159b-4b5f-ac22-a08458bfc94d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:33.691276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c48c1494-159b-4b5f-ac22-a08458bfc94d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:33.708166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c1494-159b-4b5f-ac22-a08458bfc94d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:33.748693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c1494-159b-4b5f-ac22-a08458bfc94d service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:33.768869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1282/2534] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:33 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:34.808542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4ee8-fa7d-4106-97a8-01ab326b0569 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:34.812704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4ee8-fa7d-4106-97a8-01ab326b0569 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:34.812704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9d4ee8-fa7d-4106-97a8-01ab326b0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:34.850318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-dc9d4ee8-fa7d-4106-97a8-01ab326b0569 None None] MFA Rules not processed for user `6e842d84327242988b38f13a9a4ac51d`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:34.851795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dc9d4ee8-fa7d-4106-97a8-01ab326b0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:34.940134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1253/2535] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:34 2022] POST /identity/v3/auth/tokens => generated 3753 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:34.952369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c1494-159b-4b5f-ac22-a08458bfc94d service nova] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:34.963909 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c1494-159b-4b5f-ac22-a08458bfc94d service nova] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:34.969409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16cf74-5ba1-4cdc-828b-a95bbcf140b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:34.969984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16cf74-5ba1-4cdc-828b-a95bbcf140b4 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:34.970354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16cf74-5ba1-4cdc-828b-a95bbcf140b4 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:34.970634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16cf74-5ba1-4cdc-828b-a95bbcf140b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:34.972326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-4a16cf74-5ba1-4cdc-828b-a95bbcf140b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:35.040015 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16cf74-5ba1-4cdc-828b-a95bbcf140b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:35.065824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16cf74-5ba1-4cdc-828b-a95bbcf140b4 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:35.075505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1283/2536] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:34 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:37.551762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4ee8-fa7d-4106-97a8-01ab326b0569 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:37.579277 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9d4ee8-fa7d-4106-97a8-01ab326b0569 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:37.592192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:37.592805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:37.593095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:37.593378 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:37.601409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:37.622785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:37.664480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:37.685987 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1254/2537] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:37 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:37.985317 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81578d7d-ec19-4740-a013-591d914469c7 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:37.986551 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81578d7d-ec19-4740-a013-591d914469c7 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:37.986927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81578d7d-ec19-4740-a013-591d914469c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:38.009554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-81578d7d-ec19-4740-a013-591d914469c7 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:38.010682 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-81578d7d-ec19-4740-a013-591d914469c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:38.083673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1284/2538] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:15:37 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:38.097556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:38.105262 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:38.203210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89d8d3-7931-41c9-b399-b00cd0a03000 service nova] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:38.209344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45460e89-dcca-4051-b712-d5ab0586dbc1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:38.210439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45460e89-dcca-4051-b712-d5ab0586dbc1 service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:38.210943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45460e89-dcca-4051-b712-d5ab0586dbc1 service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:38.211463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45460e89-dcca-4051-b712-d5ab0586dbc1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:38.221043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45460e89-dcca-4051-b712-d5ab0586dbc1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:38.248843 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45460e89-dcca-4051-b712-d5ab0586dbc1 service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:38.258318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1255/2539] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:15:39.448871 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce57bf-cc07-4ef9-9d3f-fc636a3ebed2 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:39.449414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce57bf-cc07-4ef9-9d3f-fc636a3ebed2 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:39.449560 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce57bf-cc07-4ef9-9d3f-fc636a3ebed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:39.472123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a2ce57bf-cc07-4ef9-9d3f-fc636a3ebed2 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:39.473274 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a2ce57bf-cc07-4ef9-9d3f-fc636a3ebed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:39.483299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1285/2540] 10.222.0.87 () {58 vars in 967 bytes} [Tue Jan 18 13:15:39 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:39.497739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45460e89-dcca-4051-b712-d5ab0586dbc1 service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:39.510623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45460e89-dcca-4051-b712-d5ab0586dbc1 service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:39.516483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2e2b-7830-4556-95c2-213295af5ea8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:39.518090 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2e2b-7830-4556-95c2-213295af5ea8 service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:39.518380 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2e2b-7830-4556-95c2-213295af5ea8 service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:39.518706 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c2e2b-7830-4556-95c2-213295af5ea8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:39.529032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c2e2b-7830-4556-95c2-213295af5ea8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:39.557780 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c2e2b-7830-4556-95c2-213295af5ea8 service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:39.568088 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1256/2541] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:15:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:15:40.117657 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2051b-b4af-451d-96d3-218d0662ebf1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:40.117957 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2051b-b4af-451d-96d3-218d0662ebf1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:40.118243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2051b-b4af-451d-96d3-218d0662ebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:40.149166 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-bbc2051b-b4af-451d-96d3-218d0662ebf1 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:40.150474 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-bbc2051b-b4af-451d-96d3-218d0662ebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:40.157238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1286/2542] 10.222.0.87 () {58 vars in 967 bytes} [Tue Jan 18 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:40.169648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2e2b-7830-4556-95c2-213295af5ea8 service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:40.180485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c2e2b-7830-4556-95c2-213295af5ea8 service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:40.185365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f760c2-0ac3-4767-803c-ee7e73789ea6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:40.185949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f760c2-0ac3-4767-803c-ee7e73789ea6 service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:40.186237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f760c2-0ac3-4767-803c-ee7e73789ea6 service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:40.186542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f760c2-0ac3-4767-803c-ee7e73789ea6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:40.195097 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f760c2-0ac3-4767-803c-ee7e73789ea6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:40.221247 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f760c2-0ac3-4767-803c-ee7e73789ea6 service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:40.230353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1257/2543] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:15:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:15:40.709732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594130b-a8c5-48de-8d31-24d90068163b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:40.710126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594130b-a8c5-48de-8d31-24d90068163b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:40.710314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c594130b-a8c5-48de-8d31-24d90068163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:40.734169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c594130b-a8c5-48de-8d31-24d90068163b None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:40.735353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c594130b-a8c5-48de-8d31-24d90068163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:40.742185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1287/2544] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:40.756641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f760c2-0ac3-4767-803c-ee7e73789ea6 service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:40.770697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f760c2-0ac3-4767-803c-ee7e73789ea6 service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:40.784919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10df0f-d52e-4b6e-8b27-3fd22f3bb126 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:40.784919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10df0f-d52e-4b6e-8b27-3fd22f3bb126 service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:40.784919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10df0f-d52e-4b6e-8b27-3fd22f3bb126 service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:40.784919 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10df0f-d52e-4b6e-8b27-3fd22f3bb126 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:40.795030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10df0f-d52e-4b6e-8b27-3fd22f3bb126 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:40.817896 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10df0f-d52e-4b6e-8b27-3fd22f3bb126 service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:40.833433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1258/2545] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:15:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:15:42.946430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d44fa-6ad6-46c6-8e48-71c245dffcc9 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:42.947061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d44fa-6ad6-46c6-8e48-71c245dffcc9 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:42.947061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d44fa-6ad6-46c6-8e48-71c245dffcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:42.970294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-915d44fa-6ad6-46c6-8e48-71c245dffcc9 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:42.975065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-915d44fa-6ad6-46c6-8e48-71c245dffcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:42.978821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1288/2546] 10.222.0.87 () {58 vars in 967 bytes} [Tue Jan 18 13:15:42 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:42.990497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10df0f-d52e-4b6e-8b27-3fd22f3bb126 service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:43.000731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10df0f-d52e-4b6e-8b27-3fd22f3bb126 service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:43.007111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56d71a-09fa-49c4-a5f4-17813f5909a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:43.007762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d71a-09fa-49c4-a5f4-17813f5909a8 service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:43.008055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d71a-09fa-49c4-a5f4-17813f5909a8 service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:43.008335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56d71a-09fa-49c4-a5f4-17813f5909a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:43.018301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56d71a-09fa-49c4-a5f4-17813f5909a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:43.045486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56d71a-09fa-49c4-a5f4-17813f5909a8 service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:43.056517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1259/2547] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:15:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:15:49.825845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d44fa-6ad6-46c6-8e48-71c245dffcc9 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:49.846952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d44fa-6ad6-46c6-8e48-71c245dffcc9 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:49.846952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e0a1c-6352-4444-978d-18485df11b0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:49.846952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0a1c-6352-4444-978d-18485df11b0c service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:49.846952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0a1c-6352-4444-978d-18485df11b0c service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:49.847359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0a1c-6352-4444-978d-18485df11b0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:49.848785 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d68e0a1c-6352-4444-978d-18485df11b0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:49.953616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e0a1c-6352-4444-978d-18485df11b0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:49.980471 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e0a1c-6352-4444-978d-18485df11b0c service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:49.990767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1289/2548] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:49 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:51.104886 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56d71a-09fa-49c4-a5f4-17813f5909a8 service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:51.106368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ae56d71a-09fa-49c4-a5f4-17813f5909a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:51.185704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56d71a-09fa-49c4-a5f4-17813f5909a8 service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:51.190010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:51.190800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:51.191089 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:51.191519 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] PATH_INFO: `/v3/users/6aef3ec8d95948948b7af2ea0322da9d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:51.192623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aef3ec8d95948948b7af2ea0322da9d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:51.219674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:51.422902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aef3ec8d95948948b7af2ea0322da9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:51.442433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aef3ec8d95948948b7af2ea0322da9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:51.443357 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aef3ec8d95948948b7af2ea0322da9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:51.453430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aef3ec8d95948948b7af2ea0322da9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:51.585572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aef3ec8d95948948b7af2ea0322da9d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:51.596350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1260/2549] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:15:51 2022] DELETE /identity/v3/users/6aef3ec8d95948948b7af2ea0322da9d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:15:51.601825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020cb3-e8cc-4390-872a-12e4aa650168 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:51.602669 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020cb3-e8cc-4390-872a-12e4aa650168 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:51.603354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4020cb3-e8cc-4390-872a-12e4aa650168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:51.699032 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e4020cb3-e8cc-4390-872a-12e4aa650168 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:15:51.701528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e4020cb3-e8cc-4390-872a-12e4aa650168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:51.884965 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1290/2550] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:15:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:15:51.910507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:51.913272 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:52.001125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c94ad-a912-4132-8c80-b736cb3e33cb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:52.005710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0678-d7a1-468a-acbe-4477f015a2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:52.006505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0678-d7a1-468a-acbe-4477f015a2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:52.006939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0678-d7a1-468a-acbe-4477f015a2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:52.007330 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca0678-d7a1-468a-acbe-4477f015a2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:52.024528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca0678-d7a1-468a-acbe-4477f015a2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:52.066356 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca0678-d7a1-468a-acbe-4477f015a2b4 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:52.093572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1261/2551] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:15:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:15:52.635825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4020cb3-e8cc-4390-872a-12e4aa650168 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:15:52.637055 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e4020cb3-e8cc-4390-872a-12e4aa650168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:15:52.651116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4020cb3-e8cc-4390-872a-12e4aa650168 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:15:52.656930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:15:52.663269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:15:52.663269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:15:52.663269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] PATH_INFO: `/v3/projects/b3ffb8795a9e412dad4876b86abffc02` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:15:52.663269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ffb8795a9e412dad4876b86abffc02)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:15:52.687332 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:15:52.864016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ffb8795a9e412dad4876b86abffc02', 'request_id': 'req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:52.969080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ffb8795a9e412dad4876b86abffc02', 'request_id': 'req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:52.982876 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ffb8795a9e412dad4876b86abffc02', 'request_id': 'req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:52.994214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] The token cache is being invalidate because project b3ffb8795a9e412dad4876b86abffc02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:15:52.994499 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:52.995382 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-ac538fa0-1ec6-4e39-946e-3e1dec0f927f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:15:52.997223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1291/2552] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:15:52 2022] DELETE /identity/v3/projects/b3ffb8795a9e412dad4876b86abffc02 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:16:06.892586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0678-d7a1-468a-acbe-4477f015a2b4 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:06.895073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-18ca0678-d7a1-468a-acbe-4477f015a2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:06.908112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca0678-d7a1-468a-acbe-4477f015a2b4 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:06.977126 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:06.977731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:06.978027 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:06.978308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:06.980157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:07.060636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:07.088316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:07.100379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1262/2553] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:16:06 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:16:11.027195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754941-bfb7-490b-8754-478729fdc2cc None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:11.027195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754941-bfb7-490b-8754-478729fdc2cc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:11.027195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13754941-bfb7-490b-8754-478729fdc2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:11.071530 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-13754941-bfb7-490b-8754-478729fdc2cc None None] MFA Rules not processed for user `a3dd76d6bced43f696d43e9f559e854e`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:16:11.073033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-13754941-bfb7-490b-8754-478729fdc2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:11.187377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1292/2554] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:16:11 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:16:32.696208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:32.697612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:32.772028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07330b11-270c-4f09-890f-964787ac9ad8 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:32.776550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:32.777343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:32.777637 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:32.777922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] PATH_INFO: `/v3/users/41d2533b3705474b8d08d50a5e87ad77` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:32.779047 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d2533b3705474b8d08d50a5e87ad77)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:32.805953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:33.107071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d2533b3705474b8d08d50a5e87ad77'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:33.120388 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d2533b3705474b8d08d50a5e87ad77'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:33.121070 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d2533b3705474b8d08d50a5e87ad77'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:33.129264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d2533b3705474b8d08d50a5e87ad77'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:33.204612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d2533b3705474b8d08d50a5e87ad77'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:33.218303 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1263/2555] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:16:32 2022] DELETE /identity/v3/users/41d2533b3705474b8d08d50a5e87ad77 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:16:33.221686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9e69-90d2-4c6e-9f0d-2bd7a3ea575f None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:33.222238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9e69-90d2-4c6e-9f0d-2bd7a3ea575f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:33.222238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9e69-90d2-4c6e-9f0d-2bd7a3ea575f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:33.248820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d9db9e69-90d2-4c6e-9f0d-2bd7a3ea575f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:16:33.250047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d9db9e69-90d2-4c6e-9f0d-2bd7a3ea575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:33.322698 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1293/2556] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:16:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:16:33.343355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:33.344714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:33.418838 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf1b1f-c008-4cae-82b0-67103716e811 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:33.422404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748661-4038-4e87-86cc-f236a41ce84b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:33.422988 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748661-4038-4e87-86cc-f236a41ce84b service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:33.423275 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748661-4038-4e87-86cc-f236a41ce84b service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:33.424167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748661-4038-4e87-86cc-f236a41ce84b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:33.433864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748661-4038-4e87-86cc-f236a41ce84b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:33.460049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748661-4038-4e87-86cc-f236a41ce84b service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:33.469693 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1264/2557] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:16:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:16:34.023594 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9e69-90d2-4c6e-9f0d-2bd7a3ea575f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:34.024379 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d9db9e69-90d2-4c6e-9f0d-2bd7a3ea575f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:34.036520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9e69-90d2-4c6e-9f0d-2bd7a3ea575f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:34.041608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:34.042464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:34.042761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:34.043046 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] PATH_INFO: `/v3/projects/de8f9a34366c4d849fd444dad0ab8ce0` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:34.044171 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8f9a34366c4d849fd444dad0ab8ce0)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:34.072601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:34.191656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8f9a34366c4d849fd444dad0ab8ce0', 'request_id': 'req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:34.290319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8f9a34366c4d849fd444dad0ab8ce0', 'request_id': 'req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:34.302566 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8f9a34366c4d849fd444dad0ab8ce0', 'request_id': 'req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:34.312971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] The token cache is being invalidate because project de8f9a34366c4d849fd444dad0ab8ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:16:34.313254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:34.313948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8c1bc518-9cf9-4cd5-bd96-eea6326cd805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:16:34.316122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1294/2558] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:16:34 2022] DELETE /identity/v3/projects/de8f9a34366c4d849fd444dad0ab8ce0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:16:34.321899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77099d2-5407-4cc9-83c6-88e48db359ca None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:34.322369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77099d2-5407-4cc9-83c6-88e48db359ca None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:34.322481 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77099d2-5407-4cc9-83c6-88e48db359ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:34.344686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b77099d2-5407-4cc9-83c6-88e48db359ca None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:16:34.346093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b77099d2-5407-4cc9-83c6-88e48db359ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:34.427038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1265/2559] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:16:34.436511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6139c-93d3-4d7f-be2c-892529856af4 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:34.437004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6139c-93d3-4d7f-be2c-892529856af4 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:34.437574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6139c-93d3-4d7f-be2c-892529856af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:34.481715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-45f6139c-93d3-4d7f-be2c-892529856af4 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:16:34.483286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-45f6139c-93d3-4d7f-be2c-892529856af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:34.499904 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1295/2560] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:16:34.501164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77099d2-5407-4cc9-83c6-88e48db359ca None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:34.514103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77099d2-5407-4cc9-83c6-88e48db359ca None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:34.519284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d033a81-496f-4fff-98c0-e2a60545ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:34.519924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d033a81-496f-4fff-98c0-e2a60545ce69 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:34.520206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d033a81-496f-4fff-98c0-e2a60545ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:34.520483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d033a81-496f-4fff-98c0-e2a60545ce69 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:34.521181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d033a81-496f-4fff-98c0-e2a60545ce69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:16:34.521478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d033a81-496f-4fff-98c0-e2a60545ce69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:34.547692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d033a81-496f-4fff-98c0-e2a60545ce69 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:34.566116 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1266/2561] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:16:34.567346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6139c-93d3-4d7f-be2c-892529856af4 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:34.576131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6139c-93d3-4d7f-be2c-892529856af4 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:34.581238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4145a4-a17a-4014-b59a-f515402d2aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:34.581831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4145a4-a17a-4014-b59a-f515402d2aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:34.582122 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4145a4-a17a-4014-b59a-f515402d2aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:34.582401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4145a4-a17a-4014-b59a-f515402d2aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:34.583033 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4145a4-a17a-4014-b59a-f515402d2aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:34.608798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4145a4-a17a-4014-b59a-f515402d2aa1 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:34.718337 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1296/2562] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:16:34 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:16:34.721333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d033a81-496f-4fff-98c0-e2a60545ce69 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:34.731197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d033a81-496f-4fff-98c0-e2a60545ce69 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:34.796254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef2d15-40a6-4c72-b939-58e458c2fbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:34.796861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef2d15-40a6-4c72-b939-58e458c2fbbe admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:34.797161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef2d15-40a6-4c72-b939-58e458c2fbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:34.797422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef2d15-40a6-4c72-b939-58e458c2fbbe admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:34.798063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef2d15-40a6-4c72-b939-58e458c2fbbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:34.826068 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef2d15-40a6-4c72-b939-58e458c2fbbe admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:34.928534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1267/2563] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:16:34 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:16:34.932483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4145a4-a17a-4014-b59a-f515402d2aa1 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:34.943017 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4145a4-a17a-4014-b59a-f515402d2aa1 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:34.947567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf4aa5-05ca-47bd-b9e3-3610359e56e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:34.948161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf4aa5-05ca-47bd-b9e3-3610359e56e8 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:34.948451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf4aa5-05ca-47bd-b9e3-3610359e56e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:34.948737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf4aa5-05ca-47bd-b9e3-3610359e56e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:34.949458 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf4aa5-05ca-47bd-b9e3-3610359e56e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:34.975898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf4aa5-05ca-47bd-b9e3-3610359e56e8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:34.988210 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1297/2564] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:16:34.992417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef2d15-40a6-4c72-b939-58e458c2fbbe admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:35.002954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef2d15-40a6-4c72-b939-58e458c2fbbe admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:35.007546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeef48-795b-4ecd-9434-2614cfaa8e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:35.008361 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeef48-795b-4ecd-9434-2614cfaa8e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:35.008646 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeef48-795b-4ecd-9434-2614cfaa8e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:35.009035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eeef48-795b-4ecd-9434-2614cfaa8e2d admin admin] PATH_INFO: `/v3/projects/e2dfd24669034b03a3fd0005ea00452d/users/e27deeb35d9f4d2cb771da441eb6d7b8/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:35.029539 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eeef48-795b-4ecd-9434-2614cfaa8e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dfd24669034b03a3fd0005ea00452d, user_id=e27deeb35d9f4d2cb771da441eb6d7b8, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:35.057615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eeef48-795b-4ecd-9434-2614cfaa8e2d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:35.141883 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1268/2565] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:16:34 2022] PUT /identity/v3/projects/e2dfd24669034b03a3fd0005ea00452d/users/e27deeb35d9f4d2cb771da441eb6d7b8/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:16:35.147288 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94954a0b-c3df-4ced-bc4c-c860cac38da6 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:35.150558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94954a0b-c3df-4ced-bc4c-c860cac38da6 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:35.150558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94954a0b-c3df-4ced-bc4c-c860cac38da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:35.170613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-94954a0b-c3df-4ced-bc4c-c860cac38da6 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:16:35.171821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-94954a0b-c3df-4ced-bc4c-c860cac38da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:35.239087 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1298/2566] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:16:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:16:35.249243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeef48-795b-4ecd-9434-2614cfaa8e2d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:35.250875 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-26eeef48-795b-4ecd-9434-2614cfaa8e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:35.315854 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eeef48-795b-4ecd-9434-2614cfaa8e2d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:35.319252 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589eab5-7053-4ff0-aedf-04dafb1a12a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:35.319864 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589eab5-7053-4ff0-aedf-04dafb1a12a9 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:35.320155 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589eab5-7053-4ff0-aedf-04dafb1a12a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:35.320433 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589eab5-7053-4ff0-aedf-04dafb1a12a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:35.329171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589eab5-7053-4ff0-aedf-04dafb1a12a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:35.354926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589eab5-7053-4ff0-aedf-04dafb1a12a9 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:35.365030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1269/2567] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:16:35 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:16:37.092469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac22c0d-3e4d-403b-b0ee-700aa63e9005 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:37.093069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac22c0d-3e4d-403b-b0ee-700aa63e9005 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:37.093174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac22c0d-3e4d-403b-b0ee-700aa63e9005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:37.135546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7ac22c0d-3e4d-403b-b0ee-700aa63e9005 None None] MFA Rules not processed for user `e27deeb35d9f4d2cb771da441eb6d7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:16:37.137954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7ac22c0d-3e4d-403b-b0ee-700aa63e9005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:37.228816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1299/2568] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:16:37 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:16:37.239929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589eab5-7053-4ff0-aedf-04dafb1a12a9 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:37.241727 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a589eab5-7053-4ff0-aedf-04dafb1a12a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:37.327280 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589eab5-7053-4ff0-aedf-04dafb1a12a9 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:37.331739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313eec7-13e0-4ea1-8181-2a16ac99617c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:37.332452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313eec7-13e0-4ea1-8181-2a16ac99617c service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:37.332811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313eec7-13e0-4ea1-8181-2a16ac99617c service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:37.333101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313eec7-13e0-4ea1-8181-2a16ac99617c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:37.342317 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313eec7-13e0-4ea1-8181-2a16ac99617c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:37.369369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313eec7-13e0-4ea1-8181-2a16ac99617c service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:37.379647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1270/2569] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:16:37 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:16:40.535606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138c642-6b6d-4af4-85d1-16251cd31973 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:40.536160 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138c642-6b6d-4af4-85d1-16251cd31973 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:40.536294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138c642-6b6d-4af4-85d1-16251cd31973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:40.568664 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-3138c642-6b6d-4af4-85d1-16251cd31973 None None] MFA Rules not processed for user `e27deeb35d9f4d2cb771da441eb6d7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:16:40.571810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3138c642-6b6d-4af4-85d1-16251cd31973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:40.581772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1300/2570] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:16:40 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:16:41.684949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313eec7-13e0-4ea1-8181-2a16ac99617c service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:16:41.694204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313eec7-13e0-4ea1-8181-2a16ac99617c service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:16:41.697590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2610bf-b2e2-4817-a741-cd0b3b4a4311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:16:41.698166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2610bf-b2e2-4817-a741-cd0b3b4a4311 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:16:41.698455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2610bf-b2e2-4817-a741-cd0b3b4a4311 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:16:41.698776 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2610bf-b2e2-4817-a741-cd0b3b4a4311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:16:41.700753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6f2610bf-b2e2-4817-a741-cd0b3b4a4311 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:16:41.772463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2610bf-b2e2-4817-a741-cd0b3b4a4311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:16:41.798129 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2610bf-b2e2-4817-a741-cd0b3b4a4311 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:16:41.808112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1271/2571] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:16:41 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:17:29.093232 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2729-bdd2-444d-ad33-d34bcef43c35 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:17:29.093788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2729-bdd2-444d-ad33-d34bcef43c35 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:17:29.093890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e2729-bdd2-444d-ad33-d34bcef43c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:17:29.118427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-791e2729-bdd2-444d-ad33-d34bcef43c35 None None] MFA Rules not processed for user `9dbcf5bc8a794a6cb12844dafc3bc9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:17:29.119487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-791e2729-bdd2-444d-ad33-d34bcef43c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:17:29.185451 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1301/2572] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:17:29 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:17:48.097041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4129fc-923f-4563-9b86-d9a5bb4e4327 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:17:48.097525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4129fc-923f-4563-9b86-d9a5bb4e4327 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:17:48.097618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4129fc-923f-4563-9b86-d9a5bb4e4327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:17:48.120290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-fc4129fc-923f-4563-9b86-d9a5bb4e4327 None None] MFA Rules not processed for user `3d2197ff17dd4ed0a7b90d40b09829f0`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:17:48.121434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-fc4129fc-923f-4563-9b86-d9a5bb4e4327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:17:48.186916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1272/2573] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:17:48 2022] POST /identity/v3/auth/tokens => generated 3682 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:18:07.941838 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2729-bdd2-444d-ad33-d34bcef43c35 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:18:07.943395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-791e2729-bdd2-444d-ad33-d34bcef43c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:18:08.026009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e2729-bdd2-444d-ad33-d34bcef43c35 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:18:08.031577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:18:08.032247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:18:08.032605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:18:08.032895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:18:08.034661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:18:08.049885 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:18:08.094249 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:18:08.108439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1302/2574] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:18:07 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:18:22.463656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629887cf-d0a6-42e4-a6b8-04e69bb0769e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:18:22.464230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629887cf-d0a6-42e4-a6b8-04e69bb0769e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:18:22.464230 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629887cf-d0a6-42e4-a6b8-04e69bb0769e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:18:22.486209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-629887cf-d0a6-42e4-a6b8-04e69bb0769e None None] MFA Rules not processed for user `e27deeb35d9f4d2cb771da441eb6d7b8`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:18:22.487516 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-629887cf-d0a6-42e4-a6b8-04e69bb0769e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:18:22.493781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1273/2575] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:18:22 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:19:37.962111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:19:37.964357 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:37.975867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41744913-c3b0-4dab-bb39-821bb75fa7f6 service placement] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:19:37.979202 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a99954-f4e8-4d33-80ba-6e589d03204b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:19:37.979808 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99954-f4e8-4d33-80ba-6e589d03204b service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:37.980099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99954-f4e8-4d33-80ba-6e589d03204b service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:37.980383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a99954-f4e8-4d33-80ba-6e589d03204b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:37.982013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-72a99954-f4e8-4d33-80ba-6e589d03204b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:38.075691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99954-f4e8-4d33-80ba-6e589d03204b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:19:38.106022 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a99954-f4e8-4d33-80ba-6e589d03204b service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:19:38.119177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1303/2576] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:19:37 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:19:39.391862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629887cf-d0a6-42e4-a6b8-04e69bb0769e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:19:39.402075 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629887cf-d0a6-42e4-a6b8-04e69bb0769e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:19:39.405501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2908-d34e-43d6-bb34-29b9bd3db981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:19:39.406076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2908-d34e-43d6-bb34-29b9bd3db981 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:39.406859 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2908-d34e-43d6-bb34-29b9bd3db981 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:39.407215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf2908-d34e-43d6-bb34-29b9bd3db981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:39.409020 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5ccf2908-d34e-43d6-bb34-29b9bd3db981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:39.422570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf2908-d34e-43d6-bb34-29b9bd3db981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:19:39.448133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf2908-d34e-43d6-bb34-29b9bd3db981 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:19:39.459750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1274/2577] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:19:39 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:19:44.431804 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a1b1d-7053-4cea-ac5a-aceaa92578b7 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:44.432190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a1b1d-7053-4cea-ac5a-aceaa92578b7 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:44.432367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575a1b1d-7053-4cea-ac5a-aceaa92578b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:44.457286 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-575a1b1d-7053-4cea-ac5a-aceaa92578b7 None None] MFA Rules not processed for user `a3dd76d6bced43f696d43e9f559e854e`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:19:44.458430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-575a1b1d-7053-4cea-ac5a-aceaa92578b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:44.526065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1304/2578] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:19:44 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:19:46.043146 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2908-d34e-43d6-bb34-29b9bd3db981 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:19:46.058876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf2908-d34e-43d6-bb34-29b9bd3db981 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:19:46.065719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b06c7c-9b51-4ea5-8486-4c3d090d3855 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:19:46.070463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06c7c-9b51-4ea5-8486-4c3d090d3855 service placement] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:46.070463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06c7c-9b51-4ea5-8486-4c3d090d3855 service placement] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:46.070463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b06c7c-9b51-4ea5-8486-4c3d090d3855 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:46.070463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e8b06c7c-9b51-4ea5-8486-4c3d090d3855 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:46.091181 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06c7c-9b51-4ea5-8486-4c3d090d3855 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:19:46.122593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b06c7c-9b51-4ea5-8486-4c3d090d3855 service placement] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:19:46.136200 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1275/2579] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:19:46 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:19:46.243111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a1b1d-7053-4cea-ac5a-aceaa92578b7 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:19:46.244464 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-575a1b1d-7053-4cea-ac5a-aceaa92578b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:46.259247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575a1b1d-7053-4cea-ac5a-aceaa92578b7 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:19:46.264007 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db6df3-a8be-4805-a5b3-6ce8e4c027a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:19:46.264591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db6df3-a8be-4805-a5b3-6ce8e4c027a1 service placement] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:46.264874 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db6df3-a8be-4805-a5b3-6ce8e4c027a1 service placement] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:46.265151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db6df3-a8be-4805-a5b3-6ce8e4c027a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:46.267875 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-15db6df3-a8be-4805-a5b3-6ce8e4c027a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:46.279328 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db6df3-a8be-4805-a5b3-6ce8e4c027a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:19:46.317982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db6df3-a8be-4805-a5b3-6ce8e4c027a1 service placement] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:19:46.321390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1305/2580] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:19:46 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:19:46.647831 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9092b23-d4b9-438a-a540-df032afe6db7 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:46.648226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9092b23-d4b9-438a-a540-df032afe6db7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:46.648576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9092b23-d4b9-438a-a540-df032afe6db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:46.676184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-e9092b23-d4b9-438a-a540-df032afe6db7 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:19:46.677333 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e9092b23-d4b9-438a-a540-df032afe6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:46.696752 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db6df3-a8be-4805-a5b3-6ce8e4c027a1 service placement] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:19:46.708073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db6df3-a8be-4805-a5b3-6ce8e4c027a1 service placement] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:19:46.713057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:19:46.713870 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:46.714154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:46.714444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] PATH_INFO: `/v3/users/e27deeb35d9f4d2cb771da441eb6d7b8` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:46.715741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e27deeb35d9f4d2cb771da441eb6d7b8)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:19:46.742645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:19:46.750498 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1276/2581] 10.222.0.87 () {58 vars in 967 bytes} [Tue Jan 18 13:19:46 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:19:46.968015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9092b23-d4b9-438a-a540-df032afe6db7 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:19:46.969616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e9092b23-d4b9-438a-a540-df032afe6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:47.023466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e27deeb35d9f4d2cb771da441eb6d7b8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.024168 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e27deeb35d9f4d2cb771da441eb6d7b8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.032253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e27deeb35d9f4d2cb771da441eb6d7b8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.044384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e27deeb35d9f4d2cb771da441eb6d7b8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.051574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9092b23-d4b9-438a-a540-df032afe6db7 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:19:47.056853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b158bd3-c6f9-4240-b480-16041ee3a2e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:19:47.057447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158bd3-c6f9-4240-b480-16041ee3a2e2 service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:47.059427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158bd3-c6f9-4240-b480-16041ee3a2e2 service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:47.059427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b158bd3-c6f9-4240-b480-16041ee3a2e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:47.068199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b158bd3-c6f9-4240-b480-16041ee3a2e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:19:47.094784 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b158bd3-c6f9-4240-b480-16041ee3a2e2 service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:19:47.101190 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e27deeb35d9f4d2cb771da441eb6d7b8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.111966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1306/2582] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:19:46 2022] DELETE /identity/v3/users/e27deeb35d9f4d2cb771da441eb6d7b8 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:19:47.112734 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1277/2583] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:19:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 18 13:19:47.533242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:19:47.535042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:47.612430 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e405a2-cb8a-442f-a85e-88d7fb924d61 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:19:47.616915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:19:47.617815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:47.618106 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:47.618385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] PATH_INFO: `/v3/projects/e2dfd24669034b03a3fd0005ea00452d` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:47.619604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2dfd24669034b03a3fd0005ea00452d)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:19:47.646020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:19:47.798795 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2dfd24669034b03a3fd0005ea00452d', 'request_id': 'req-0cb188c7-f609-4889-8afc-033adbe90dce'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.861508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2dfd24669034b03a3fd0005ea00452d', 'request_id': 'req-0cb188c7-f609-4889-8afc-033adbe90dce'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.960598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2dfd24669034b03a3fd0005ea00452d', 'request_id': 'req-0cb188c7-f609-4889-8afc-033adbe90dce'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.979607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] The token cache is being invalidate because project e2dfd24669034b03a3fd0005ea00452d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:19:47.980110 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.980895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:19:47.983223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1307/2584] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:19:47 2022] DELETE /identity/v3/projects/e2dfd24669034b03a3fd0005ea00452d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:19:48.380936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b158bd3-c6f9-4240-b480-16041ee3a2e2 service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:19:48.395976 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b158bd3-c6f9-4240-b480-16041ee3a2e2 service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:19:48.466714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:19:48.467662 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:48.468109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:48.468939 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:48.471833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:48.556733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:19:48.583019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:19:48.599584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1278/2585] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:19:48 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:19:54.157633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:19:54.159236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:54.245319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb188c7-f609-4889-8afc-033adbe90dce admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:19:54.251724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d5890-2aee-488f-b8e2-aea8499eba1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:19:54.251933 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d5890-2aee-488f-b8e2-aea8499eba1b service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:19:54.252244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d5890-2aee-488f-b8e2-aea8499eba1b service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:19:54.252607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d5890-2aee-488f-b8e2-aea8499eba1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:19:54.254624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-fe1d5890-2aee-488f-b8e2-aea8499eba1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:19:54.426837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d5890-2aee-488f-b8e2-aea8499eba1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:19:54.456496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d5890-2aee-488f-b8e2-aea8499eba1b service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:19:54.483066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1308/2586] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3694 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:20:04.100918 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:04.106079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:04.114414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d655b4e-6043-45da-9251-fa8e3ebd5a12 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:04.118761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:04.119604 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:04.119910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:04.120179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] PATH_INFO: `/v3/users/1d5d20d1cfd543d989cd803c592d4ca3` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:04.121351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5d20d1cfd543d989cd803c592d4ca3)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:04.147723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:04.312975 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5d20d1cfd543d989cd803c592d4ca3'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:04.324723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5d20d1cfd543d989cd803c592d4ca3'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:04.325363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5d20d1cfd543d989cd803c592d4ca3'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:04.336719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5d20d1cfd543d989cd803c592d4ca3'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:04.408318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5d20d1cfd543d989cd803c592d4ca3'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:04.414651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1279/2587] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:20:04 2022] DELETE /identity/v3/users/1d5d20d1cfd543d989cd803c592d4ca3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:20:04.757685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d5890-2aee-488f-b8e2-aea8499eba1b service nova] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:04.770815 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d5890-2aee-488f-b8e2-aea8499eba1b service nova] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:04.839895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:04.840958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:04.841331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:04.841690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] PATH_INFO: `/v3/projects/c5ee90cc67ab40cd8bef0b0639fee7fe` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:04.843914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ee90cc67ab40cd8bef0b0639fee7fe)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:04.881386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:05.010477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ee90cc67ab40cd8bef0b0639fee7fe', 'request_id': 'req-b4e47a4e-6a2a-4309-ba18-f852493e8965'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.082873 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ee90cc67ab40cd8bef0b0639fee7fe', 'request_id': 'req-b4e47a4e-6a2a-4309-ba18-f852493e8965'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.101362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ee90cc67ab40cd8bef0b0639fee7fe', 'request_id': 'req-b4e47a4e-6a2a-4309-ba18-f852493e8965'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.114604 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] The token cache is being invalidate because project c5ee90cc67ab40cd8bef0b0639fee7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:20:05.119034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.119034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.119034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1309/2588] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:20:04 2022] DELETE /identity/v3/projects/c5ee90cc67ab40cd8bef0b0639fee7fe => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:20:05.121398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:05.123024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:05.137118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56894a5-b19c-47c7-8391-fcec9f32e774 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:05.211985 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:05.212874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:05.213163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:05.213445 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] PATH_INFO: `/v3/users/96ffc47737804d2f90cc71a61c136d8a` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:05.214643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ffc47737804d2f90cc71a61c136d8a)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:05.243001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:05.466929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ffc47737804d2f90cc71a61c136d8a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.479214 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ffc47737804d2f90cc71a61c136d8a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.479908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ffc47737804d2f90cc71a61c136d8a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.488297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ffc47737804d2f90cc71a61c136d8a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.573833 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ffc47737804d2f90cc71a61c136d8a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:05.580261 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1280/2589] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:20:05 2022] DELETE /identity/v3/users/96ffc47737804d2f90cc71a61c136d8a => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:20:05.933242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:05.935265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:05.948654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e47a4e-6a2a-4309-ba18-f852493e8965 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:06.016730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:06.017527 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:06.018087 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:06.018365 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] PATH_INFO: `/v3/projects/6aa87380d6ee4a70b2fdc35cdcb31ae3` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:06.019504 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa87380d6ee4a70b2fdc35cdcb31ae3)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:06.045623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:06.215323 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa87380d6ee4a70b2fdc35cdcb31ae3', 'request_id': 'req-cb344e77-611b-47d9-a250-760b48160247'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:06.362224 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa87380d6ee4a70b2fdc35cdcb31ae3', 'request_id': 'req-cb344e77-611b-47d9-a250-760b48160247'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:06.374766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa87380d6ee4a70b2fdc35cdcb31ae3', 'request_id': 'req-cb344e77-611b-47d9-a250-760b48160247'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:06.387130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] The token cache is being invalidate because project 6aa87380d6ee4a70b2fdc35cdcb31ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:20:06.387462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:06.388095 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:06.389715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1310/2590] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:20:05 2022] DELETE /identity/v3/projects/6aa87380d6ee4a70b2fdc35cdcb31ae3 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:20:07.698755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:07.700575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:07.777844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e27ac3-1f1e-41c3-9d61-40e94c5f3e0a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:07.838525 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:07.839208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:07.839642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:07.839933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:07.841717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:07.854948 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:07.881673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:07.890502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1281/2591] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:20:07 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:20:41.240148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:41.241623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:41.345220 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb344e77-611b-47d9-a250-760b48160247 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:41.351401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f371e4-4161-467d-9527-317badfdbe90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:41.351998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f371e4-4161-467d-9527-317badfdbe90 service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:41.352301 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f371e4-4161-467d-9527-317badfdbe90 service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:41.352574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f371e4-4161-467d-9527-317badfdbe90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:41.354406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c4f371e4-4161-467d-9527-317badfdbe90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:41.370857 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f371e4-4161-467d-9527-317badfdbe90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:41.397807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f371e4-4161-467d-9527-317badfdbe90 service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:41.409774 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1311/2592] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:20:41 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:20:43.086164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:43.089140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:43.121104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a2ad2-1a4f-47e6-bf9c-9444276883ad service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:43.121104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:43.121104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:43.121104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:43.121432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:43.121432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:43.133515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:43.161514 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:43.175375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1282/2593] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:20:43 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:20:44.863930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a16842-e6a1-4be2-9651-1d4c140e9315 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:44.864768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a16842-e6a1-4be2-9651-1d4c140e9315 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:44.874544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a16842-e6a1-4be2-9651-1d4c140e9315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:44.889001 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-91a16842-e6a1-4be2-9651-1d4c140e9315 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:20:44.890705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-91a16842-e6a1-4be2-9651-1d4c140e9315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:44.967545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1312/2594] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:20:44 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:20:44.979977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:44.981313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:45.077497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f580c-0408-429e-b0b8-a3bcf8a38272 service nova] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:45.089578 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff396c2-12c5-4f6c-88ff-7e1bcc0895d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:45.090179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff396c2-12c5-4f6c-88ff-7e1bcc0895d7 service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:45.090466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff396c2-12c5-4f6c-88ff-7e1bcc0895d7 service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:45.090747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff396c2-12c5-4f6c-88ff-7e1bcc0895d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:45.101091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff396c2-12c5-4f6c-88ff-7e1bcc0895d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:45.129311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff396c2-12c5-4f6c-88ff-7e1bcc0895d7 service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:45.138401 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1283/2595] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:20:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:20:49.525242 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a16842-e6a1-4be2-9651-1d4c140e9315 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:49.527212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-91a16842-e6a1-4be2-9651-1d4c140e9315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:49.598712 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a16842-e6a1-4be2-9651-1d4c140e9315 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:49.602214 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:49.602865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:49.603224 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:49.603585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:49.605368 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:49.718750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:49.744434 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:49.768319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1313/2596] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:20:49 2022] GET /identity/v3/auth/tokens => generated 3682 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:20:51.803039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff396c2-12c5-4f6c-88ff-7e1bcc0895d7 service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:51.803039 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-cff396c2-12c5-4f6c-88ff-7e1bcc0895d7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:51.815556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff396c2-12c5-4f6c-88ff-7e1bcc0895d7 service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:51.819376 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e3314-32f6-4f57-a42a-4790809e01e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:51.820436 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e3314-32f6-4f57-a42a-4790809e01e9 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:51.820823 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e3314-32f6-4f57-a42a-4790809e01e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:51.821355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e3314-32f6-4f57-a42a-4790809e01e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:51.823346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b16e3314-32f6-4f57-a42a-4790809e01e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:51.910297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e3314-32f6-4f57-a42a-4790809e01e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:51.937345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e3314-32f6-4f57-a42a-4790809e01e9 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:51.948605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1284/2597] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:20:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:20:59.591660 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:20:59.593650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:20:59.606258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103099bd-c79a-4d16-a00d-b9ed4f5a8eb5 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:20:59.611520 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:20:59.612408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:20:59.612605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:20:59.612883 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] PATH_INFO: `/v3/users/3d2197ff17dd4ed0a7b90d40b09829f0` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:20:59.613962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2197ff17dd4ed0a7b90d40b09829f0)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:20:59.640051 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:20:59.820079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2197ff17dd4ed0a7b90d40b09829f0'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:59.820696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2197ff17dd4ed0a7b90d40b09829f0'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:59.828834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2197ff17dd4ed0a7b90d40b09829f0'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:59.840641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2197ff17dd4ed0a7b90d40b09829f0'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:59.944404 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-826cc319-faab-48e6-bd2d-b70d704c5dd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2197ff17dd4ed0a7b90d40b09829f0'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:20:59.951341 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1314/2598] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:20:59 2022] DELETE /identity/v3/users/3d2197ff17dd4ed0a7b90d40b09829f0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:21:00.292239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e3314-32f6-4f57-a42a-4790809e01e9 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:00.303083 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e3314-32f6-4f57-a42a-4790809e01e9 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:00.370606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:00.371337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:00.371633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:00.371916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] PATH_INFO: `/v3/projects/68b28824eec64ec5aaa6b2c018208c8e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:00.373008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b28824eec64ec5aaa6b2c018208c8e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:00.402483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:00.521813 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b28824eec64ec5aaa6b2c018208c8e', 'request_id': 'req-8811cd4c-6328-4455-81da-69f2cf067e31'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:21:00.589546 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b28824eec64ec5aaa6b2c018208c8e', 'request_id': 'req-8811cd4c-6328-4455-81da-69f2cf067e31'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:21:00.601486 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b28824eec64ec5aaa6b2c018208c8e', 'request_id': 'req-8811cd4c-6328-4455-81da-69f2cf067e31'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:21:00.611906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] The token cache is being invalidate because project 68b28824eec64ec5aaa6b2c018208c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:21:00.612186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:21:00.612805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8811cd4c-6328-4455-81da-69f2cf067e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:21:00.614217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1285/2599] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:21:00 2022] DELETE /identity/v3/projects/68b28824eec64ec5aaa6b2c018208c8e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:21:00.620108 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df88468-4901-4f20-8861-03150653e6aa None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:00.620583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df88468-4901-4f20-8861-03150653e6aa None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:00.620736 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df88468-4901-4f20-8861-03150653e6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:00.644061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7df88468-4901-4f20-8861-03150653e6aa None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:21:00.645204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7df88468-4901-4f20-8861-03150653e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:00.709746 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1315/2600] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:21:00.717826 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d1dcf-5623-46e5-9534-ea40020361e7 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:00.718145 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d1dcf-5623-46e5-9534-ea40020361e7 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:00.718404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d1dcf-5623-46e5-9534-ea40020361e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:00.741253 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-5f6d1dcf-5623-46e5-9534-ea40020361e7 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:21:00.742386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5f6d1dcf-5623-46e5-9534-ea40020361e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:00.750697 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1286/2601] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:21:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:21:00.755027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df88468-4901-4f20-8861-03150653e6aa None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:00.771049 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df88468-4901-4f20-8861-03150653e6aa None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:00.777750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2a21b-0719-4e12-96ca-9ce94c55dfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:00.778646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a21b-0719-4e12-96ca-9ce94c55dfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:00.779179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a21b-0719-4e12-96ca-9ce94c55dfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:00.779593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2a21b-0719-4e12-96ca-9ce94c55dfb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:00.780325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2a21b-0719-4e12-96ca-9ce94c55dfb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:21:00.780858 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2a21b-0719-4e12-96ca-9ce94c55dfb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:00.806962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2a21b-0719-4e12-96ca-9ce94c55dfb9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:00.820637 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1316/2602] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:21:00.824973 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d1dcf-5623-46e5-9534-ea40020361e7 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:00.834175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d1dcf-5623-46e5-9534-ea40020361e7 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:00.838801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eb80b-5a45-4313-bcd3-2ccfcf4421bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:00.839423 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eb80b-5a45-4313-bcd3-2ccfcf4421bb admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:00.839717 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eb80b-5a45-4313-bcd3-2ccfcf4421bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:00.840000 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eb80b-5a45-4313-bcd3-2ccfcf4421bb admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:00.840638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eb80b-5a45-4313-bcd3-2ccfcf4421bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:00.868631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eb80b-5a45-4313-bcd3-2ccfcf4421bb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:00.968292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1287/2603] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:21:00 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:21:00.972732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2a21b-0719-4e12-96ca-9ce94c55dfb9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:00.982335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2a21b-0719-4e12-96ca-9ce94c55dfb9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:01.046408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839ba67-d0a2-4fbf-b4a4-c8f732a84237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:01.047012 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839ba67-d0a2-4fbf-b4a4-c8f732a84237 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:01.047294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839ba67-d0a2-4fbf-b4a4-c8f732a84237 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:01.047603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839ba67-d0a2-4fbf-b4a4-c8f732a84237 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:01.048246 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839ba67-d0a2-4fbf-b4a4-c8f732a84237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:01.073634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839ba67-d0a2-4fbf-b4a4-c8f732a84237 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:01.144441 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1317/2604] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:21:00 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:21:01.148531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eb80b-5a45-4313-bcd3-2ccfcf4421bb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:01.159217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eb80b-5a45-4313-bcd3-2ccfcf4421bb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:01.163468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee377c83-6224-48ae-bcb8-fac32c0b0ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:01.164100 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377c83-6224-48ae-bcb8-fac32c0b0ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:01.164338 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377c83-6224-48ae-bcb8-fac32c0b0ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:01.164666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee377c83-6224-48ae-bcb8-fac32c0b0ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:01.165351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee377c83-6224-48ae-bcb8-fac32c0b0ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:01.191559 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee377c83-6224-48ae-bcb8-fac32c0b0ef5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:01.203373 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1288/2605] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:21:01.207982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839ba67-d0a2-4fbf-b4a4-c8f732a84237 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:01.220831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839ba67-d0a2-4fbf-b4a4-c8f732a84237 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:01.225282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9817a3-a5ed-4a7d-b6b0-2bde679d714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:01.226315 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9817a3-a5ed-4a7d-b6b0-2bde679d714c admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:01.226679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9817a3-a5ed-4a7d-b6b0-2bde679d714c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:01.227035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9817a3-a5ed-4a7d-b6b0-2bde679d714c admin admin] PATH_INFO: `/v3/projects/15b6d9d1b82a4911978cd65518e7677f/users/97c52c057d224ee7a96de5f14c710c0c/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:01.249558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9817a3-a5ed-4a7d-b6b0-2bde679d714c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b6d9d1b82a4911978cd65518e7677f, user_id=97c52c057d224ee7a96de5f14c710c0c, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:01.278534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9817a3-a5ed-4a7d-b6b0-2bde679d714c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:01.344642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1318/2606] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:21:01 2022] PUT /identity/v3/projects/15b6d9d1b82a4911978cd65518e7677f/users/97c52c057d224ee7a96de5f14c710c0c/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:21:01.349542 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f300-5c08-4d94-9827-4f0da68fc9b1 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:01.350078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f300-5c08-4d94-9827-4f0da68fc9b1 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:01.350226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8f300-5c08-4d94-9827-4f0da68fc9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:01.373035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1bb8f300-5c08-4d94-9827-4f0da68fc9b1 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:21:01.374853 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1bb8f300-5c08-4d94-9827-4f0da68fc9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:01.440469 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1289/2607] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:21:01 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:21:01.450344 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9817a3-a5ed-4a7d-b6b0-2bde679d714c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:01.452084 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7c9817a3-a5ed-4a7d-b6b0-2bde679d714c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:01.517259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9817a3-a5ed-4a7d-b6b0-2bde679d714c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:01.520921 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7d60e-72e2-4e9c-94a0-0261930b5889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:01.521491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7d60e-72e2-4e9c-94a0-0261930b5889 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:01.521779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7d60e-72e2-4e9c-94a0-0261930b5889 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:01.522061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7d60e-72e2-4e9c-94a0-0261930b5889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:01.531329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7d60e-72e2-4e9c-94a0-0261930b5889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:01.557856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff7d60e-72e2-4e9c-94a0-0261930b5889 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:01.570043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1319/2608] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:21:01 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:21:03.099032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c40c-6d9c-4687-a31c-d5f52e206d5f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:03.099655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c40c-6d9c-4687-a31c-d5f52e206d5f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:03.099655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a9c40c-6d9c-4687-a31c-d5f52e206d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:03.237955 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b4a9c40c-6d9c-4687-a31c-d5f52e206d5f None None] MFA Rules not processed for user `97c52c057d224ee7a96de5f14c710c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:21:03.239127 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b4a9c40c-6d9c-4687-a31c-d5f52e206d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:03.325332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1290/2609] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:21:03 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:21:03.335846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945738e-fe9a-4197-85d4-43585e1cd012 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:03.338239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945738e-fe9a-4197-85d4-43585e1cd012 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:03.338239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945738e-fe9a-4197-85d4-43585e1cd012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:03.361988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c945738e-fe9a-4197-85d4-43585e1cd012 None None] MFA Rules not processed for user `97c52c057d224ee7a96de5f14c710c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:21:03.363173 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c945738e-fe9a-4197-85d4-43585e1cd012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:03.369930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1320/2610] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:21:03 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:21:03.381579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c40c-6d9c-4687-a31c-d5f52e206d5f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:03.384131 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b4a9c40c-6d9c-4687-a31c-d5f52e206d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:03.469431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a9c40c-6d9c-4687-a31c-d5f52e206d5f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:03.475035 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca02a-44a9-4fb0-aa24-21906523d71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:03.479072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca02a-44a9-4fb0-aa24-21906523d71a service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:03.479072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca02a-44a9-4fb0-aa24-21906523d71a service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:03.479072 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eca02a-44a9-4fb0-aa24-21906523d71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:03.485884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eca02a-44a9-4fb0-aa24-21906523d71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:03.512081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eca02a-44a9-4fb0-aa24-21906523d71a service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:03.523431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1291/2611] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:21:03 2022] GET /identity/v3/auth/tokens => generated 3692 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:21:03.928057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945738e-fe9a-4197-85d4-43585e1cd012 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:03.929369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c945738e-fe9a-4197-85d4-43585e1cd012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:03.941534 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945738e-fe9a-4197-85d4-43585e1cd012 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:03.945303 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191d68a3-eafe-4a22-8129-6a49c3b75b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:03.945895 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d68a3-eafe-4a22-8129-6a49c3b75b25 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:03.946185 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d68a3-eafe-4a22-8129-6a49c3b75b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:03.946472 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191d68a3-eafe-4a22-8129-6a49c3b75b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:03.948208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-191d68a3-eafe-4a22-8129-6a49c3b75b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:03.958583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d68a3-eafe-4a22-8129-6a49c3b75b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:03.983985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191d68a3-eafe-4a22-8129-6a49c3b75b25 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:03.993176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1321/2612] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:21:03 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:21:06.014259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca02a-44a9-4fb0-aa24-21906523d71a service nova] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:06.025753 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eca02a-44a9-4fb0-aa24-21906523d71a service nova] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:06.029548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:06.030190 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:06.030476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:06.030752 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:06.032530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:06.041931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:06.068375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:06.076600 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1292/2613] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:21:06 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:21:13.010153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ed24-45c0-45c3-affb-298c6b57d475 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:13.010661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ed24-45c0-45c3-affb-298c6b57d475 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:13.010856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355ed24-45c0-45c3-affb-298c6b57d475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:13.036762 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-5355ed24-45c0-45c3-affb-298c6b57d475 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:21:13.037919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5355ed24-45c0-45c3-affb-298c6b57d475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:13.109164 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1322/2614] 10.222.0.87 () {58 vars in 1014 bytes} [Tue Jan 18 13:21:13 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:21:13.120631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:13.121958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:13.195951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e8fb51-1459-404f-b9a5-6d7d038f7627 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:13.200495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a2b83-ca59-41d9-a6c7-00e6531f6310 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:13.201069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a2b83-ca59-41d9-a6c7-00e6531f6310 service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:13.201352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a2b83-ca59-41d9-a6c7-00e6531f6310 service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:13.202299 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a2b83-ca59-41d9-a6c7-00e6531f6310 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:13.210249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a2b83-ca59-41d9-a6c7-00e6531f6310 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:13.236955 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a2b83-ca59-41d9-a6c7-00e6531f6310 service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:13.244747 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1293/2615] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:21:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 18 13:21:33.838514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acd65c-0941-4002-b49f-cb4f05887636 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:33.839072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acd65c-0941-4002-b49f-cb4f05887636 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:33.839176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64acd65c-0941-4002-b49f-cb4f05887636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:33.883347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-64acd65c-0941-4002-b49f-cb4f05887636 None None] MFA Rules not processed for user `54e44c49e9ac4ea5bfed707bc26d6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:21:33.885002 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-64acd65c-0941-4002-b49f-cb4f05887636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:33.921438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1323/2616] 10.222.0.87 () {58 vars in 967 bytes} [Tue Jan 18 13:21:33 2022] POST /identity/v3/auth/tokens => generated 3625 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:21:33.940572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a2b83-ca59-41d9-a6c7-00e6531f6310 service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:33.985271 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a2b83-ca59-41d9-a6c7-00e6531f6310 service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:33.989979 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273acc5-daef-4204-9fc5-5f965df232cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e99d0fbbc86b4a629b9fffb4d9565216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:33.990566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273acc5-daef-4204-9fc5-5f965df232cd service swift] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:33.990855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273acc5-daef-4204-9fc5-5f965df232cd service swift] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:33.991136 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273acc5-daef-4204-9fc5-5f965df232cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:34.000463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273acc5-daef-4204-9fc5-5f965df232cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:34.026795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273acc5-daef-4204-9fc5-5f965df232cd service swift] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:34.035664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1294/2617] 10.222.0.87 () {60 vars in 1384 bytes} [Tue Jan 18 13:21:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 18 13:21:41.634405 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63461c-b991-4964-a995-c7e51f26a74c None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:41.634976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63461c-b991-4964-a995-c7e51f26a74c None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:41.634976 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63461c-b991-4964-a995-c7e51f26a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:41.657879 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-0b63461c-b991-4964-a995-c7e51f26a74c None None] MFA Rules not processed for user `97c52c057d224ee7a96de5f14c710c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:21:41.659041 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-0b63461c-b991-4964-a995-c7e51f26a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:41.665565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1324/2618] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:21:41 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:21:42.355554 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273acc5-daef-4204-9fc5-5f965df232cd service swift] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:21:42.377576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273acc5-daef-4204-9fc5-5f965df232cd service swift] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:21:42.381019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:21:42.381597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:21:42.381884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:21:42.382166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:21:42.383858 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:21:42.413586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:21:42.439573 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:21:42.448153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1295/2619] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:21:42 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:22:02.336061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b583-0ea6-4cf3-946a-9dde9c107bd0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:22:02.342675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b583-0ea6-4cf3-946a-9dde9c107bd0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:22:02.342675 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6b583-0ea6-4cf3-946a-9dde9c107bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:22:02.358508 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-98b6b583-0ea6-4cf3-946a-9dde9c107bd0 None None] MFA Rules not processed for user `97c52c057d224ee7a96de5f14c710c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:22:02.359689 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-98b6b583-0ea6-4cf3-946a-9dde9c107bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:22:02.366218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1325/2620] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:22:02 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:22:14.711000 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:22:14.712928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:22:14.778426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f5068-3397-485a-a334-eb532d2ed281 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:22:14.781983 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49dfef0-c16d-47e2-bd8d-72bfed1b3488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:22:14.782605 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dfef0-c16d-47e2-bd8d-72bfed1b3488 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:22:14.782905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dfef0-c16d-47e2-bd8d-72bfed1b3488 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:22:14.783175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49dfef0-c16d-47e2-bd8d-72bfed1b3488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:22:14.784892 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b49dfef0-c16d-47e2-bd8d-72bfed1b3488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:22:14.857199 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49dfef0-c16d-47e2-bd8d-72bfed1b3488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:22:14.882430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49dfef0-c16d-47e2-bd8d-72bfed1b3488 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:22:14.893276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1296/2621] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:22:14 2022] GET /identity/v3/auth/tokens => generated 3684 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:22:28.252482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ba34-f208-43b0-b79b-f3f39addd67e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:22:28.253072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ba34-f208-43b0-b79b-f3f39addd67e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:22:28.253072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647ba34-f208-43b0-b79b-f3f39addd67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:22:28.275229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-1647ba34-f208-43b0-b79b-f3f39addd67e None None] MFA Rules not processed for user `a3dd76d6bced43f696d43e9f559e854e`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:22:28.276416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-1647ba34-f208-43b0-b79b-f3f39addd67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:22:28.283381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1326/2622] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:22:28 2022] POST /identity/v3/auth/tokens => generated 3684 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:22:40.941206 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd420-2760-49f7-a83e-729dc725616f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:22:40.941782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd420-2760-49f7-a83e-729dc725616f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:22:40.941915 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd420-2760-49f7-a83e-729dc725616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:22:40.964315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-f2cfd420-2760-49f7-a83e-729dc725616f None None] MFA Rules not processed for user `97c52c057d224ee7a96de5f14c710c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:22:40.965451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f2cfd420-2760-49f7-a83e-729dc725616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:22:40.971993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1297/2623] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:22:40 2022] POST /identity/v3/auth/tokens => generated 3692 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:22:56.057684 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ba34-f208-43b0-b79b-f3f39addd67e None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:22:56.068271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647ba34-f208-43b0-b79b-f3f39addd67e None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:22:56.071743 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b790c12-994d-4d9f-9565-5c8a91bc3d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:22:56.072321 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790c12-994d-4d9f-9565-5c8a91bc3d4e service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:22:56.072608 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790c12-994d-4d9f-9565-5c8a91bc3d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:22:56.072986 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790c12-994d-4d9f-9565-5c8a91bc3d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:22:56.074766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7b790c12-994d-4d9f-9565-5c8a91bc3d4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:22:56.158363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b790c12-994d-4d9f-9565-5c8a91bc3d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:22:56.184072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b790c12-994d-4d9f-9565-5c8a91bc3d4e service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:22:56.194913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1327/2624] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:22:56 2022] GET /identity/v3/auth/tokens => generated 3753 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:11.767410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd420-2760-49f7-a83e-729dc725616f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:11.773115 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f2cfd420-2760-49f7-a83e-729dc725616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:11.887443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd420-2760-49f7-a83e-729dc725616f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:11.889817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:11.890081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:11.890368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:11.890781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:11.893536 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:11.906084 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:11.931504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:11.942027 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1298/2625] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:11 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:17.127038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b790c12-994d-4d9f-9565-5c8a91bc3d4e service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:17.136217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b790c12-994d-4d9f-9565-5c8a91bc3d4e service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:17.139825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af9b99-dc9c-47a1-9d14-16e13ff77057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:17.140396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af9b99-dc9c-47a1-9d14-16e13ff77057 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:17.140683 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af9b99-dc9c-47a1-9d14-16e13ff77057 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:17.140963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af9b99-dc9c-47a1-9d14-16e13ff77057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:17.142587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-34af9b99-dc9c-47a1-9d14-16e13ff77057 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:17.183268 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af9b99-dc9c-47a1-9d14-16e13ff77057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:17.210299 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af9b99-dc9c-47a1-9d14-16e13ff77057 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:17.230501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1328/2626] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:17 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:23:23.768978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:23.770610 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:23.784432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d76c8e-cc23-4333-baa6-d2348a72002a service placement] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:23.788987 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:23.789787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:23.790081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:23.790473 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] PATH_INFO: `/v3/users/9dbcf5bc8a794a6cb12844dafc3bc9e1` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:23.791949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbcf5bc8a794a6cb12844dafc3bc9e1)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:23.818431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:24.046304 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbcf5bc8a794a6cb12844dafc3bc9e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.059128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbcf5bc8a794a6cb12844dafc3bc9e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.063535 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbcf5bc8a794a6cb12844dafc3bc9e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.068801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbcf5bc8a794a6cb12844dafc3bc9e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.140922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d6ae5526-f7db-46df-8396-2019936d3ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbcf5bc8a794a6cb12844dafc3bc9e1'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.147489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1299/2627] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:23 2022] DELETE /identity/v3/users/9dbcf5bc8a794a6cb12844dafc3bc9e1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:24.439449 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af9b99-dc9c-47a1-9d14-16e13ff77057 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:24.451446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af9b99-dc9c-47a1-9d14-16e13ff77057 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:24.519788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:24.520629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:24.520920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:24.521203 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] PATH_INFO: `/v3/projects/fc2e74ac67b84fd5bd577cc130119449` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:24.522331 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2e74ac67b84fd5bd577cc130119449)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:24.548085 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:24.656417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2e74ac67b84fd5bd577cc130119449', 'request_id': 'req-fea219c1-6d83-4130-8470-5ca6f1650ce4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.718189 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2e74ac67b84fd5bd577cc130119449', 'request_id': 'req-fea219c1-6d83-4130-8470-5ca6f1650ce4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.731184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2e74ac67b84fd5bd577cc130119449', 'request_id': 'req-fea219c1-6d83-4130-8470-5ca6f1650ce4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.741492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] The token cache is being invalidate because project fc2e74ac67b84fd5bd577cc130119449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:24.741778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.742443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-fea219c1-6d83-4130-8470-5ca6f1650ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:24.744780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1329/2628] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:24 2022] DELETE /identity/v3/projects/fc2e74ac67b84fd5bd577cc130119449 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:23:24.750844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e4640-2d6e-4896-8d22-f83e635fab58 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:24.751134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e4640-2d6e-4896-8d22-f83e635fab58 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:24.751452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e4640-2d6e-4896-8d22-f83e635fab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:24.836748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-365e4640-2d6e-4896-8d22-f83e635fab58 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:24.838054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-365e4640-2d6e-4896-8d22-f83e635fab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:24.905659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1300/2629] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:24.914384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd1f99-fe59-442e-9c6a-af8cf9c03a7b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:24.914682 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd1f99-fe59-442e-9c6a-af8cf9c03a7b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:24.914970 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd1f99-fe59-442e-9c6a-af8cf9c03a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:24.937984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-99fd1f99-fe59-442e-9c6a-af8cf9c03a7b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:24.939135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-99fd1f99-fe59-442e-9c6a-af8cf9c03a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:24.946324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1330/2630] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:24 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:24.950760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e4640-2d6e-4896-8d22-f83e635fab58 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:24.959928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e4640-2d6e-4896-8d22-f83e635fab58 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:24.964467 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615456c-d53f-4ae1-be01-300796900f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:24.965081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615456c-d53f-4ae1-be01-300796900f01 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:24.965364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615456c-d53f-4ae1-be01-300796900f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:24.965640 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615456c-d53f-4ae1-be01-300796900f01 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:24.966331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615456c-d53f-4ae1-be01-300796900f01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:23:24.966621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615456c-d53f-4ae1-be01-300796900f01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:24.992609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615456c-d53f-4ae1-be01-300796900f01 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:25.006606 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1301/2631] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:23:25.011429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd1f99-fe59-442e-9c6a-af8cf9c03a7b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:25.020954 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd1f99-fe59-442e-9c6a-af8cf9c03a7b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:25.025810 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90f8de-867c-44ed-a623-303a3e5e6934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:25.026550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90f8de-867c-44ed-a623-303a3e5e6934 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:25.026841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90f8de-867c-44ed-a623-303a3e5e6934 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:25.027123 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90f8de-867c-44ed-a623-303a3e5e6934 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:25.027784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90f8de-867c-44ed-a623-303a3e5e6934 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:25.054000 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90f8de-867c-44ed-a623-303a3e5e6934 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:25.142730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1331/2632] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:25 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:25.146871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615456c-d53f-4ae1-be01-300796900f01 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:25.156851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615456c-d53f-4ae1-be01-300796900f01 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:25.220451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ffcdb-6feb-41a0-b6c1-365fb16560c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:25.221057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ffcdb-6feb-41a0-b6c1-365fb16560c8 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:25.221344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ffcdb-6feb-41a0-b6c1-365fb16560c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:25.221628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ffcdb-6feb-41a0-b6c1-365fb16560c8 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:25.222267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ffcdb-6feb-41a0-b6c1-365fb16560c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:25.248623 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ffcdb-6feb-41a0-b6c1-365fb16560c8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:25.342980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1302/2633] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:25 2022] POST /identity/v3/users => generated 303 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:25.347134 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90f8de-867c-44ed-a623-303a3e5e6934 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:25.358459 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90f8de-867c-44ed-a623-303a3e5e6934 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:25.362772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f67a4e-2aa4-4b89-aee4-a0d86e243804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:25.363401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67a4e-2aa4-4b89-aee4-a0d86e243804 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:25.363694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67a4e-2aa4-4b89-aee4-a0d86e243804 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:25.363983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f67a4e-2aa4-4b89-aee4-a0d86e243804 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:25.364676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f67a4e-2aa4-4b89-aee4-a0d86e243804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:25.391988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f67a4e-2aa4-4b89-aee4-a0d86e243804 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:25.403737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1332/2634] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:23:25.408161 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ffcdb-6feb-41a0-b6c1-365fb16560c8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:25.418267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ffcdb-6feb-41a0-b6c1-365fb16560c8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:25.422582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9723606-2964-4dca-a6ff-aaa631cae083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:25.423432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9723606-2964-4dca-a6ff-aaa631cae083 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:25.423721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9723606-2964-4dca-a6ff-aaa631cae083 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:25.424002 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9723606-2964-4dca-a6ff-aaa631cae083 admin admin] PATH_INFO: `/v3/projects/860639824e0746cf98e074df767a3f9e/users/40f0bbcb2c1649a29cfe1a104c84d3dd/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:25.444052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9723606-2964-4dca-a6ff-aaa631cae083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860639824e0746cf98e074df767a3f9e, user_id=40f0bbcb2c1649a29cfe1a104c84d3dd, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:25.472582 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9723606-2964-4dca-a6ff-aaa631cae083 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:25.581162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1303/2635] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:25 2022] PUT /identity/v3/projects/860639824e0746cf98e074df767a3f9e/users/40f0bbcb2c1649a29cfe1a104c84d3dd/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:25.592276 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667a5b2-3dc5-48e2-bcaa-facff222ee73 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:25.592809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667a5b2-3dc5-48e2-bcaa-facff222ee73 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:25.592929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667a5b2-3dc5-48e2-bcaa-facff222ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:25.628798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e667a5b2-3dc5-48e2-bcaa-facff222ee73 None None] MFA Rules not processed for user `40f0bbcb2c1649a29cfe1a104c84d3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:25.630738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e667a5b2-3dc5-48e2-bcaa-facff222ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:25.718667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1333/2636] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:25 2022] POST /identity/v3/auth/tokens => generated 3712 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:25.723086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9723606-2964-4dca-a6ff-aaa631cae083 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:25.796350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9723606-2964-4dca-a6ff-aaa631cae083 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:25.800730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563acd1-0c9b-4b75-99d0-32810b768064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:25.801290 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563acd1-0c9b-4b75-99d0-32810b768064 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:25.801590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563acd1-0c9b-4b75-99d0-32810b768064 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:25.801879 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563acd1-0c9b-4b75-99d0-32810b768064 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:25.802648 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563acd1-0c9b-4b75-99d0-32810b768064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:25.829380 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563acd1-0c9b-4b75-99d0-32810b768064 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:25.948587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1304/2637] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:25 2022] POST /identity/v3/projects => generated 403 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:25.952990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667a5b2-3dc5-48e2-bcaa-facff222ee73 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:25.964083 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667a5b2-3dc5-48e2-bcaa-facff222ee73 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:26.028995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639cb55-9b09-4245-a627-4a80f4543727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:26.029600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639cb55-9b09-4245-a627-4a80f4543727 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:26.029887 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639cb55-9b09-4245-a627-4a80f4543727 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:26.030167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639cb55-9b09-4245-a627-4a80f4543727 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:26.030798 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639cb55-9b09-4245-a627-4a80f4543727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:26.056813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639cb55-9b09-4245-a627-4a80f4543727 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:26.153403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1334/2638] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:25 2022] POST /identity/v3/users => generated 308 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:26.157279 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563acd1-0c9b-4b75-99d0-32810b768064 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:26.166956 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563acd1-0c9b-4b75-99d0-32810b768064 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:26.172186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c762d-3efe-4b23-b1a7-4fbbe1356fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:26.172186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c762d-3efe-4b23-b1a7-4fbbe1356fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:26.172186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c762d-3efe-4b23-b1a7-4fbbe1356fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:26.172497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c762d-3efe-4b23-b1a7-4fbbe1356fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:26.172970 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c762d-3efe-4b23-b1a7-4fbbe1356fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:26.199170 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c762d-3efe-4b23-b1a7-4fbbe1356fa4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:26.210454 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1305/2639] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:26.215259 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639cb55-9b09-4245-a627-4a80f4543727 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:26.224902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639cb55-9b09-4245-a627-4a80f4543727 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:26.229243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db04758-7be8-4663-ad1e-f94d7a67df4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:26.230050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db04758-7be8-4663-ad1e-f94d7a67df4d admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:26.230337 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db04758-7be8-4663-ad1e-f94d7a67df4d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:26.230618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db04758-7be8-4663-ad1e-f94d7a67df4d admin admin] PATH_INFO: `/v3/projects/64f1e00ecf814edebfc11d5a352ddd41/users/d2b9c032cc9e4b389820a28f0f0507b2/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:26.252034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db04758-7be8-4663-ad1e-f94d7a67df4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f1e00ecf814edebfc11d5a352ddd41, user_id=d2b9c032cc9e4b389820a28f0f0507b2, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:26.279609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db04758-7be8-4663-ad1e-f94d7a67df4d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:26.387258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1335/2640] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:26 2022] PUT /identity/v3/projects/64f1e00ecf814edebfc11d5a352ddd41/users/d2b9c032cc9e4b389820a28f0f0507b2/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:26.391432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c762d-3efe-4b23-b1a7-4fbbe1356fa4 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:26.401568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c762d-3efe-4b23-b1a7-4fbbe1356fa4 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:26.465724 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd108354-6fbe-41b5-8260-e0e6299ec91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:26.466337 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108354-6fbe-41b5-8260-e0e6299ec91a admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:26.466624 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108354-6fbe-41b5-8260-e0e6299ec91a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:26.466901 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd108354-6fbe-41b5-8260-e0e6299ec91a admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:26.467622 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd108354-6fbe-41b5-8260-e0e6299ec91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:26.492785 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd108354-6fbe-41b5-8260-e0e6299ec91a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:26.504328 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1306/2641] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:26.508697 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db04758-7be8-4663-ad1e-f94d7a67df4d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:26.520176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db04758-7be8-4663-ad1e-f94d7a67df4d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:26.524550 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fc8c5-636e-40b3-8fae-62a4d524be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:26.527554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fc8c5-636e-40b3-8fae-62a4d524be70 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:26.527554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fc8c5-636e-40b3-8fae-62a4d524be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:26.527554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fc8c5-636e-40b3-8fae-62a4d524be70 admin admin] PATH_INFO: `/v3/projects/64f1e00ecf814edebfc11d5a352ddd41/users/d2b9c032cc9e4b389820a28f0f0507b2/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:26.528987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fc8c5-636e-40b3-8fae-62a4d524be70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f1e00ecf814edebfc11d5a352ddd41, user_id=d2b9c032cc9e4b389820a28f0f0507b2, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:26.555631 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838fc8c5-636e-40b3-8fae-62a4d524be70 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:26.567667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1336/2642] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:26 2022] PUT /identity/v3/projects/64f1e00ecf814edebfc11d5a352ddd41/users/d2b9c032cc9e4b389820a28f0f0507b2/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:26.572410 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd108354-6fbe-41b5-8260-e0e6299ec91a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:26.582094 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd108354-6fbe-41b5-8260-e0e6299ec91a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:26.654406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e42068-ebb7-4397-bbd7-88214e4227d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:26.655150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e42068-ebb7-4397-bbd7-88214e4227d4 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:26.655579 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e42068-ebb7-4397-bbd7-88214e4227d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:26.656025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e42068-ebb7-4397-bbd7-88214e4227d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:26.656800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e42068-ebb7-4397-bbd7-88214e4227d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:26.691923 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e42068-ebb7-4397-bbd7-88214e4227d4 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:26.703447 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1307/2643] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:26.707761 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fc8c5-636e-40b3-8fae-62a4d524be70 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:26.717541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fc8c5-636e-40b3-8fae-62a4d524be70 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:26.721693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328ac88-6794-4b06-b20a-322f77224f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:26.722482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328ac88-6794-4b06-b20a-322f77224f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:26.722763 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328ac88-6794-4b06-b20a-322f77224f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:26.723037 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328ac88-6794-4b06-b20a-322f77224f60 admin admin] PATH_INFO: `/v3/projects/64f1e00ecf814edebfc11d5a352ddd41/users/d2b9c032cc9e4b389820a28f0f0507b2/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:26.724800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328ac88-6794-4b06-b20a-322f77224f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f1e00ecf814edebfc11d5a352ddd41, user_id=d2b9c032cc9e4b389820a28f0f0507b2, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:26.751411 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328ac88-6794-4b06-b20a-322f77224f60 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:26.821583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1337/2644] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:26 2022] PUT /identity/v3/projects/64f1e00ecf814edebfc11d5a352ddd41/users/d2b9c032cc9e4b389820a28f0f0507b2/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:26.833201 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041cb45-444a-4e7e-ac6f-21b956e12ea5 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:26.833506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041cb45-444a-4e7e-ac6f-21b956e12ea5 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:26.833796 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a041cb45-444a-4e7e-ac6f-21b956e12ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:26.871874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-a041cb45-444a-4e7e-ac6f-21b956e12ea5 None None] MFA Rules not processed for user `d2b9c032cc9e4b389820a28f0f0507b2`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:26.873025 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a041cb45-444a-4e7e-ac6f-21b956e12ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:26.950512 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1308/2645] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:26 2022] POST /identity/v3/auth/tokens => generated 3777 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:26.959889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328ac88-6794-4b06-b20a-322f77224f60 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:26.961486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e328ac88-6794-4b06-b20a-322f77224f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:27.065396 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328ac88-6794-4b06-b20a-322f77224f60 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:27.069251 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2af774-400d-46fe-ae93-c0b15d359efc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:27.069826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2af774-400d-46fe-ae93-c0b15d359efc service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:27.070496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2af774-400d-46fe-ae93-c0b15d359efc service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:27.070496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2af774-400d-46fe-ae93-c0b15d359efc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:27.081281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2af774-400d-46fe-ae93-c0b15d359efc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:27.108679 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2af774-400d-46fe-ae93-c0b15d359efc service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:27.119673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1338/2646] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:26 2022] GET /identity/v3/auth/tokens => generated 3777 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:27.277743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041cb45-444a-4e7e-ac6f-21b956e12ea5 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:27.345396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a041cb45-444a-4e7e-ac6f-21b956e12ea5 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:27.349416 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:27.350236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:27.350521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:27.350801 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] PATH_INFO: `/v3/users/40f0bbcb2c1649a29cfe1a104c84d3dd` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:27.351929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f0bbcb2c1649a29cfe1a104c84d3dd)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:27.377930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:27.601592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f0bbcb2c1649a29cfe1a104c84d3dd'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:27.613850 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f0bbcb2c1649a29cfe1a104c84d3dd'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:27.614527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f0bbcb2c1649a29cfe1a104c84d3dd'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:27.622141 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f0bbcb2c1649a29cfe1a104c84d3dd'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:27.700650 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f0bbcb2c1649a29cfe1a104c84d3dd'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:27.706990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1309/2647] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:27 2022] DELETE /identity/v3/users/40f0bbcb2c1649a29cfe1a104c84d3dd => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:27.711618 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4504b7e-b093-4c70-8af2-acb3d182f514 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:27.712170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4504b7e-b093-4c70-8af2-acb3d182f514 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:27.712939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4504b7e-b093-4c70-8af2-acb3d182f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:27.735784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-f4504b7e-b093-4c70-8af2-acb3d182f514 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:27.736927 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f4504b7e-b093-4c70-8af2-acb3d182f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:27.804829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1339/2648] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:27 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:27.815291 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:27.816711 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:27.880054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4528a8-42e8-4193-afd4-2067187d611f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:27.883397 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbb7e-b848-406b-9cec-e1c16f1f72b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:27.883990 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbb7e-b848-406b-9cec-e1c16f1f72b2 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:27.885063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbb7e-b848-406b-9cec-e1c16f1f72b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:27.885651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbb7e-b848-406b-9cec-e1c16f1f72b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:27.894402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dbb7e-b848-406b-9cec-e1c16f1f72b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:27.920273 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dbb7e-b848-406b-9cec-e1c16f1f72b2 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:27.929751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1310/2649] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:27 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:28.617938 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4504b7e-b093-4c70-8af2-acb3d182f514 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:28.619898 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f4504b7e-b093-4c70-8af2-acb3d182f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:28.631694 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4504b7e-b093-4c70-8af2-acb3d182f514 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:28.638993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:28.640060 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:28.640462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:28.641014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] PATH_INFO: `/v3/projects/860639824e0746cf98e074df767a3f9e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:28.642212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=860639824e0746cf98e074df767a3f9e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:28.669611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:28.794824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860639824e0746cf98e074df767a3f9e', 'request_id': 'req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:28.860930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860639824e0746cf98e074df767a3f9e', 'request_id': 'req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:28.873576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860639824e0746cf98e074df767a3f9e', 'request_id': 'req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:28.883384 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] The token cache is being invalidate because project 860639824e0746cf98e074df767a3f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:28.883674 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:28.884911 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:28.886349 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1340/2650] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:28 2022] DELETE /identity/v3/projects/860639824e0746cf98e074df767a3f9e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:28.890627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbb7e-b848-406b-9cec-e1c16f1f72b2 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:28.900622 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbb7e-b848-406b-9cec-e1c16f1f72b2 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:28.965343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:28.966077 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:28.966363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:28.966643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] PATH_INFO: `/v3/users/d2b9c032cc9e4b389820a28f0f0507b2` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:28.968023 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2b9c032cc9e4b389820a28f0f0507b2)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:28.996232 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:29.230856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2b9c032cc9e4b389820a28f0f0507b2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:29.244087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2b9c032cc9e4b389820a28f0f0507b2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:29.244817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2b9c032cc9e4b389820a28f0f0507b2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:29.253270 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2b9c032cc9e4b389820a28f0f0507b2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:29.335651 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-25f5b222-1bb5-4356-8e4d-45bf8d51a393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2b9c032cc9e4b389820a28f0f0507b2'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:29.344674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1311/2651] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:28 2022] DELETE /identity/v3/users/d2b9c032cc9e4b389820a28f0f0507b2 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:29.847194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:29.851263 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:29.866269 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2d43f-4a82-4c1c-b685-39a349eef2d8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:29.939090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:29.939929 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:29.940218 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:29.940507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] PATH_INFO: `/v3/projects/64f1e00ecf814edebfc11d5a352ddd41` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:29.941606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f1e00ecf814edebfc11d5a352ddd41)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:29.967892 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:30.102198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f1e00ecf814edebfc11d5a352ddd41', 'request_id': 'req-794c63d1-b624-4a07-9481-ff00bf21743e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:30.175107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f1e00ecf814edebfc11d5a352ddd41', 'request_id': 'req-794c63d1-b624-4a07-9481-ff00bf21743e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:30.188097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f1e00ecf814edebfc11d5a352ddd41', 'request_id': 'req-794c63d1-b624-4a07-9481-ff00bf21743e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:30.198539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] The token cache is being invalidate because project 64f1e00ecf814edebfc11d5a352ddd41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:30.198820 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:30.199479 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-794c63d1-b624-4a07-9481-ff00bf21743e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:30.200889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1341/2652] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:29 2022] DELETE /identity/v3/projects/64f1e00ecf814edebfc11d5a352ddd41 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:30.207422 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167e225-8383-4bbb-8b3c-9480147efa19 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:30.213440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167e225-8383-4bbb-8b3c-9480147efa19 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:30.213440 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167e225-8383-4bbb-8b3c-9480147efa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:30.233989 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-1167e225-8383-4bbb-8b3c-9480147efa19 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:30.235119 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1167e225-8383-4bbb-8b3c-9480147efa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:30.301769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1312/2653] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:23:30.309768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66766a8-f536-40d6-bc49-2123d43295ed None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:30.310020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66766a8-f536-40d6-bc49-2123d43295ed None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:30.311732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66766a8-f536-40d6-bc49-2123d43295ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:30.333194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a66766a8-f536-40d6-bc49-2123d43295ed None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:30.334328 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a66766a8-f536-40d6-bc49-2123d43295ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:30.341960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1342/2654] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:30 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:30.346584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167e225-8383-4bbb-8b3c-9480147efa19 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:30.356951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167e225-8383-4bbb-8b3c-9480147efa19 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:30.362158 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d4dcd-eb36-4500-84d4-2ddc05279077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:30.362158 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d4dcd-eb36-4500-84d4-2ddc05279077 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:30.362158 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d4dcd-eb36-4500-84d4-2ddc05279077 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:30.362500 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d4dcd-eb36-4500-84d4-2ddc05279077 admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:30.363028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d4dcd-eb36-4500-84d4-2ddc05279077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:23:30.363347 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d4dcd-eb36-4500-84d4-2ddc05279077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:30.389855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d4dcd-eb36-4500-84d4-2ddc05279077 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:30.403876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1313/2655] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:23:30.408461 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66766a8-f536-40d6-bc49-2123d43295ed None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:30.418099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66766a8-f536-40d6-bc49-2123d43295ed None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:30.422574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a9238-614d-4bbe-8fe6-3565f490401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:30.423158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9238-614d-4bbe-8fe6-3565f490401c admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:30.423478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9238-614d-4bbe-8fe6-3565f490401c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:30.423758 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a9238-614d-4bbe-8fe6-3565f490401c admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:30.424437 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a9238-614d-4bbe-8fe6-3565f490401c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:30.450751 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a9238-614d-4bbe-8fe6-3565f490401c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:30.562068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1343/2656] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:30 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:23:30.566030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d4dcd-eb36-4500-84d4-2ddc05279077 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:30.576534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d4dcd-eb36-4500-84d4-2ddc05279077 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:30.639930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634e85b-be24-4177-b2c0-8d93da9c6383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:30.640534 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634e85b-be24-4177-b2c0-8d93da9c6383 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:30.640819 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634e85b-be24-4177-b2c0-8d93da9c6383 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:30.641101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634e85b-be24-4177-b2c0-8d93da9c6383 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:30.641743 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634e85b-be24-4177-b2c0-8d93da9c6383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:30.668451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634e85b-be24-4177-b2c0-8d93da9c6383 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:30.735810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1314/2657] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:30 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:30.740237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a9238-614d-4bbe-8fe6-3565f490401c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:30.750672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a9238-614d-4bbe-8fe6-3565f490401c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:30.754916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924b673-4a4c-4a0f-8eba-ba1a2ac5d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:30.755535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b673-4a4c-4a0f-8eba-ba1a2ac5d82f admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:30.755840 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b673-4a4c-4a0f-8eba-ba1a2ac5d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:30.756104 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924b673-4a4c-4a0f-8eba-ba1a2ac5d82f admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:30.756851 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b673-4a4c-4a0f-8eba-ba1a2ac5d82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:30.783533 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924b673-4a4c-4a0f-8eba-ba1a2ac5d82f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:30.793783 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1344/2658] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:30.798063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634e85b-be24-4177-b2c0-8d93da9c6383 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:30.808323 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634e85b-be24-4177-b2c0-8d93da9c6383 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:30.812619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e57249-5ca6-4b21-b94f-77b18dbccd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:30.813409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e57249-5ca6-4b21-b94f-77b18dbccd12 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:30.813702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e57249-5ca6-4b21-b94f-77b18dbccd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:30.813973 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e57249-5ca6-4b21-b94f-77b18dbccd12 admin admin] PATH_INFO: `/v3/projects/46832ecdfb9f401b8c764da70f03d803/users/b23007ba07a2467791ffe1a590880110/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:30.834079 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e57249-5ca6-4b21-b94f-77b18dbccd12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46832ecdfb9f401b8c764da70f03d803, user_id=b23007ba07a2467791ffe1a590880110, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:30.860347 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e57249-5ca6-4b21-b94f-77b18dbccd12 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:30.918105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1315/2659] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:30 2022] PUT /identity/v3/projects/46832ecdfb9f401b8c764da70f03d803/users/b23007ba07a2467791ffe1a590880110/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:30.928375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52d3fd-426b-420a-a4c0-118174a59660 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:30.928912 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52d3fd-426b-420a-a4c0-118174a59660 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:30.929020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52d3fd-426b-420a-a4c0-118174a59660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:30.966070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-eb52d3fd-426b-420a-a4c0-118174a59660 None None] MFA Rules not processed for user `b23007ba07a2467791ffe1a590880110`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:30.967215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-eb52d3fd-426b-420a-a4c0-118174a59660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:31.037847 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1345/2660] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:30 2022] POST /identity/v3/auth/tokens => generated 3672 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:31.042507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e57249-5ca6-4b21-b94f-77b18dbccd12 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:31.114180 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e57249-5ca6-4b21-b94f-77b18dbccd12 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:31.119217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f573-87db-4c08-80e0-2fc859d6ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:31.119846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f573-87db-4c08-80e0-2fc859d6ffce admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:31.120126 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f573-87db-4c08-80e0-2fc859d6ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:31.120398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907f573-87db-4c08-80e0-2fc859d6ffce admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:31.121099 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f573-87db-4c08-80e0-2fc859d6ffce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:31.154132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907f573-87db-4c08-80e0-2fc859d6ffce admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:31.239543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1316/2661] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:31 2022] POST /identity/v3/projects => generated 363 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:31.244880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52d3fd-426b-420a-a4c0-118174a59660 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:31.255476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52d3fd-426b-420a-a4c0-118174a59660 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:31.319837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62febde0-c135-427f-b0ba-b88a6c98eb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:31.320440 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62febde0-c135-427f-b0ba-b88a6c98eb69 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:31.320737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62febde0-c135-427f-b0ba-b88a6c98eb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:31.321023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62febde0-c135-427f-b0ba-b88a6c98eb69 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:31.321714 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62febde0-c135-427f-b0ba-b88a6c98eb69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:31.349576 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62febde0-c135-427f-b0ba-b88a6c98eb69 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:31.575963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1346/2662] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:31 2022] POST /identity/v3/users => generated 288 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:31.580109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f573-87db-4c08-80e0-2fc859d6ffce admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:31.590797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907f573-87db-4c08-80e0-2fc859d6ffce admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:31.596015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fdd49-f9cf-4355-a076-7da376283ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:31.596615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fdd49-f9cf-4355-a076-7da376283ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:31.596935 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fdd49-f9cf-4355-a076-7da376283ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:31.597221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fdd49-f9cf-4355-a076-7da376283ee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:31.597910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fdd49-f9cf-4355-a076-7da376283ee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:31.624852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fdd49-f9cf-4355-a076-7da376283ee9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:31.636834 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1317/2663] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:31.652371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62febde0-c135-427f-b0ba-b88a6c98eb69 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:31.662155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62febde0-c135-427f-b0ba-b88a6c98eb69 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:31.666545 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce014-fbc4-4644-aed7-34288e58d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:31.667374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce014-fbc4-4644-aed7-34288e58d15f admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:31.667665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce014-fbc4-4644-aed7-34288e58d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:31.667948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce014-fbc4-4644-aed7-34288e58d15f admin admin] PATH_INFO: `/v3/projects/9481ce2b7b7a446e80d054e012b07a43/users/4b4eae5ae9ae4950b99f3e8c6599e235/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:31.687751 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabce014-fbc4-4644-aed7-34288e58d15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9481ce2b7b7a446e80d054e012b07a43, user_id=4b4eae5ae9ae4950b99f3e8c6599e235, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:31.716756 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabce014-fbc4-4644-aed7-34288e58d15f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:31.921027 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1347/2664] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:31 2022] PUT /identity/v3/projects/9481ce2b7b7a446e80d054e012b07a43/users/4b4eae5ae9ae4950b99f3e8c6599e235/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:31.954434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fdd49-f9cf-4355-a076-7da376283ee9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:31.964355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fdd49-f9cf-4355-a076-7da376283ee9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:32.032157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca3e06-ba36-4465-b1d6-9b2b7924cce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:32.032766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca3e06-ba36-4465-b1d6-9b2b7924cce9 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:32.033055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca3e06-ba36-4465-b1d6-9b2b7924cce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:32.033359 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca3e06-ba36-4465-b1d6-9b2b7924cce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:32.034082 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca3e06-ba36-4465-b1d6-9b2b7924cce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:32.061845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca3e06-ba36-4465-b1d6-9b2b7924cce9 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:32.076255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1318/2665] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:32.080258 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce014-fbc4-4644-aed7-34288e58d15f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:32.090644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce014-fbc4-4644-aed7-34288e58d15f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:32.095073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edcc34-7d7b-48fd-9d6f-169fbb35e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:32.096265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edcc34-7d7b-48fd-9d6f-169fbb35e049 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:32.096724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edcc34-7d7b-48fd-9d6f-169fbb35e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:32.097177 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edcc34-7d7b-48fd-9d6f-169fbb35e049 admin admin] PATH_INFO: `/v3/projects/9481ce2b7b7a446e80d054e012b07a43/users/4b4eae5ae9ae4950b99f3e8c6599e235/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:32.099406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edcc34-7d7b-48fd-9d6f-169fbb35e049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9481ce2b7b7a446e80d054e012b07a43, user_id=4b4eae5ae9ae4950b99f3e8c6599e235, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:32.129327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edcc34-7d7b-48fd-9d6f-169fbb35e049 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:32.140794 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1348/2666] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:32 2022] PUT /identity/v3/projects/9481ce2b7b7a446e80d054e012b07a43/users/4b4eae5ae9ae4950b99f3e8c6599e235/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:32.144846 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca3e06-ba36-4465-b1d6-9b2b7924cce9 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:32.154674 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca3e06-ba36-4465-b1d6-9b2b7924cce9 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:32.220423 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b20078-5dc3-419b-92ed-3dc80f5a5d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:32.220949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b20078-5dc3-419b-92ed-3dc80f5a5d3d admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:32.221243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b20078-5dc3-419b-92ed-3dc80f5a5d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:32.221527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b20078-5dc3-419b-92ed-3dc80f5a5d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:32.222223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b20078-5dc3-419b-92ed-3dc80f5a5d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:32.249654 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b20078-5dc3-419b-92ed-3dc80f5a5d3d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:32.260543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1319/2667] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:23:32.265167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edcc34-7d7b-48fd-9d6f-169fbb35e049 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:32.275988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edcc34-7d7b-48fd-9d6f-169fbb35e049 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:32.288135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab845e-e4f5-4380-8aea-a6eb63e0a20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:32.288135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab845e-e4f5-4380-8aea-a6eb63e0a20b admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:32.288135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab845e-e4f5-4380-8aea-a6eb63e0a20b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:32.288135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab845e-e4f5-4380-8aea-a6eb63e0a20b admin admin] PATH_INFO: `/v3/projects/9481ce2b7b7a446e80d054e012b07a43/users/4b4eae5ae9ae4950b99f3e8c6599e235/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:32.288690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab845e-e4f5-4380-8aea-a6eb63e0a20b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9481ce2b7b7a446e80d054e012b07a43, user_id=4b4eae5ae9ae4950b99f3e8c6599e235, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:32.311089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab845e-e4f5-4380-8aea-a6eb63e0a20b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:32.388710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1349/2668] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:32 2022] PUT /identity/v3/projects/9481ce2b7b7a446e80d054e012b07a43/users/4b4eae5ae9ae4950b99f3e8c6599e235/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:32.400779 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2bc0a-c099-464a-a0df-f3be53c0773e None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:32.405609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2bc0a-c099-464a-a0df-f3be53c0773e None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:32.405609 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2bc0a-c099-464a-a0df-f3be53c0773e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:32.439521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-bec2bc0a-c099-464a-a0df-f3be53c0773e None None] MFA Rules not processed for user `4b4eae5ae9ae4950b99f3e8c6599e235`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:32.440677 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-bec2bc0a-c099-464a-a0df-f3be53c0773e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:32.516690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1320/2669] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:32 2022] POST /identity/v3/auth/tokens => generated 3737 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:23:32.527040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab845e-e4f5-4380-8aea-a6eb63e0a20b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:32.528659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3eab845e-e4f5-4380-8aea-a6eb63e0a20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:32.598143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab845e-e4f5-4380-8aea-a6eb63e0a20b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:32.601494 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e2326-d897-4c17-8f35-3ed7aa8aa14d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:32.602066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2326-d897-4c17-8f35-3ed7aa8aa14d service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:32.602354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2326-d897-4c17-8f35-3ed7aa8aa14d service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:32.602636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e2326-d897-4c17-8f35-3ed7aa8aa14d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:32.612135 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2326-d897-4c17-8f35-3ed7aa8aa14d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:32.637707 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e2326-d897-4c17-8f35-3ed7aa8aa14d service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:32.647397 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1350/2670] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:32 2022] GET /identity/v3/auth/tokens => generated 3737 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:33.062737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2bc0a-c099-464a-a0df-f3be53c0773e None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:33.133243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2bc0a-c099-464a-a0df-f3be53c0773e None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:33.139149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:33.140036 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:33.140324 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:33.140612 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] PATH_INFO: `/v3/users/b23007ba07a2467791ffe1a590880110` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:33.141770 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23007ba07a2467791ffe1a590880110)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:33.171666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:33.320259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23007ba07a2467791ffe1a590880110'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:33.333590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23007ba07a2467791ffe1a590880110'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:33.335475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23007ba07a2467791ffe1a590880110'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:33.342213 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23007ba07a2467791ffe1a590880110'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:33.392101 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23007ba07a2467791ffe1a590880110'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:33.398340 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1321/2671] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:33 2022] DELETE /identity/v3/users/b23007ba07a2467791ffe1a590880110 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:33.403137 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598da72-5e62-42f3-95c4-7c2d45ebd05f None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:33.404369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598da72-5e62-42f3-95c4-7c2d45ebd05f None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:33.404369 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598da72-5e62-42f3-95c4-7c2d45ebd05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:33.429525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b598da72-5e62-42f3-95c4-7c2d45ebd05f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:33.430730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b598da72-5e62-42f3-95c4-7c2d45ebd05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:33.520167 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1351/2672] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:33 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:33.530556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:33.531937 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:33.597284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beb37a-c2e2-4d23-9d0e-29f6da901f11 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:33.600663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bb3df-fb35-4d43-8f7d-372f719e6f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:33.601242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bb3df-fb35-4d43-8f7d-372f719e6f2a service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:33.601527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bb3df-fb35-4d43-8f7d-372f719e6f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:33.601810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bb3df-fb35-4d43-8f7d-372f719e6f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:33.612529 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bb3df-fb35-4d43-8f7d-372f719e6f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:33.638557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bb3df-fb35-4d43-8f7d-372f719e6f2a service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:33.648209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1322/2673] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:33 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:34.114444 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598da72-5e62-42f3-95c4-7c2d45ebd05f None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:34.115852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b598da72-5e62-42f3-95c4-7c2d45ebd05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:34.127963 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598da72-5e62-42f3-95c4-7c2d45ebd05f None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:34.140387 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:34.141128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:34.141414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:34.141696 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] PATH_INFO: `/v3/projects/46832ecdfb9f401b8c764da70f03d803` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:34.142796 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=46832ecdfb9f401b8c764da70f03d803)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:34.169111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:34.261568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46832ecdfb9f401b8c764da70f03d803', 'request_id': 'req-514f12f7-6c56-4951-b046-951bab880ebf'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.323991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46832ecdfb9f401b8c764da70f03d803', 'request_id': 'req-514f12f7-6c56-4951-b046-951bab880ebf'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.336897 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46832ecdfb9f401b8c764da70f03d803', 'request_id': 'req-514f12f7-6c56-4951-b046-951bab880ebf'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.347628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] The token cache is being invalidate because project 46832ecdfb9f401b8c764da70f03d803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:34.347918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.348543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.350010 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1352/2674] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:34 2022] DELETE /identity/v3/projects/46832ecdfb9f401b8c764da70f03d803 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:34.354619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bb3df-fb35-4d43-8f7d-372f719e6f2a service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:34.363906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bb3df-fb35-4d43-8f7d-372f719e6f2a service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:34.443652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:34.444543 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:34.444899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:34.445296 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] PATH_INFO: `/v3/users/4b4eae5ae9ae4950b99f3e8c6599e235` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:34.446601 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4eae5ae9ae4950b99f3e8c6599e235)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:34.476390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:34.618880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4eae5ae9ae4950b99f3e8c6599e235'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.632594 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4eae5ae9ae4950b99f3e8c6599e235'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.633837 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4eae5ae9ae4950b99f3e8c6599e235'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.644011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4eae5ae9ae4950b99f3e8c6599e235'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.730028 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1782abda-5452-4785-ae94-501a93d1f27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4eae5ae9ae4950b99f3e8c6599e235'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:34.742766 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1323/2675] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:34 2022] DELETE /identity/v3/users/4b4eae5ae9ae4950b99f3e8c6599e235 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:23:35.276067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:35.278076 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:35.299535 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f12f7-6c56-4951-b046-951bab880ebf admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:35.388099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:35.389163 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:35.389450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:35.389724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] PATH_INFO: `/v3/projects/9481ce2b7b7a446e80d054e012b07a43` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:35.390938 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9481ce2b7b7a446e80d054e012b07a43)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:35.424421 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:35.566981 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9481ce2b7b7a446e80d054e012b07a43', 'request_id': 'req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:35.632393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9481ce2b7b7a446e80d054e012b07a43', 'request_id': 'req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:35.648987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9481ce2b7b7a446e80d054e012b07a43', 'request_id': 'req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:35.661380 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] The token cache is being invalidate because project 9481ce2b7b7a446e80d054e012b07a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:35.661691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:35.662486 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8a1a2435-d1c1-47c7-8f24-6c5b750f4e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:35.664511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1353/2676] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:35 2022] DELETE /identity/v3/projects/9481ce2b7b7a446e80d054e012b07a43 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:35.671882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a5ec-0d60-48c6-ba0d-73282ce1258f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:35.672406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a5ec-0d60-48c6-ba0d-73282ce1258f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:35.672520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3a5ec-0d60-48c6-ba0d-73282ce1258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:35.699619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-b5b3a5ec-0d60-48c6-ba0d-73282ce1258f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:35.701817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-b5b3a5ec-0d60-48c6-ba0d-73282ce1258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:35.799818 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1324/2677] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:35.809319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a0193-7de1-4f88-b6af-17d3029aba44 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:35.809715 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a0193-7de1-4f88-b6af-17d3029aba44 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:35.810366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a0193-7de1-4f88-b6af-17d3029aba44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:35.847529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-053a0193-7de1-4f88-b6af-17d3029aba44 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:35.849995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-053a0193-7de1-4f88-b6af-17d3029aba44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:35.859602 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1354/2678] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:35 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:35.863810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3a5ec-0d60-48c6-ba0d-73282ce1258f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:35.874571 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3a5ec-0d60-48c6-ba0d-73282ce1258f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:35.880055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3ac3c-4449-4b9d-9fea-8c4543e0d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:35.880668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3ac3c-4449-4b9d-9fea-8c4543e0d5cc admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:35.880952 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3ac3c-4449-4b9d-9fea-8c4543e0d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:35.881228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3ac3c-4449-4b9d-9fea-8c4543e0d5cc admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:35.881968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3ac3c-4449-4b9d-9fea-8c4543e0d5cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:23:35.882264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3ac3c-4449-4b9d-9fea-8c4543e0d5cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:35.913064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3ac3c-4449-4b9d-9fea-8c4543e0d5cc admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:35.928429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1325/2679] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:23:35.934069 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a0193-7de1-4f88-b6af-17d3029aba44 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:35.943611 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a0193-7de1-4f88-b6af-17d3029aba44 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:35.949402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f1727-d81e-43bf-99c6-17a6bdcbcedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:35.950023 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f1727-d81e-43bf-99c6-17a6bdcbcedb admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:35.950318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f1727-d81e-43bf-99c6-17a6bdcbcedb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:35.950603 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f1727-d81e-43bf-99c6-17a6bdcbcedb admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:35.951293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f1727-d81e-43bf-99c6-17a6bdcbcedb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:35.993325 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f1727-d81e-43bf-99c6-17a6bdcbcedb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:36.123179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1355/2680] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:35 2022] POST /identity/v3/projects => generated 387 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:36.125584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3ac3c-4449-4b9d-9fea-8c4543e0d5cc admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:36.137106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3ac3c-4449-4b9d-9fea-8c4543e0d5cc admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:36.213379 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df557f5-1d38-49e0-95ac-b59b4e0f0350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:36.214157 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df557f5-1d38-49e0-95ac-b59b4e0f0350 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:36.214450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df557f5-1d38-49e0-95ac-b59b4e0f0350 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:36.214737 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df557f5-1d38-49e0-95ac-b59b4e0f0350 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:36.215430 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df557f5-1d38-49e0-95ac-b59b4e0f0350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:36.242320 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df557f5-1d38-49e0-95ac-b59b4e0f0350 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:36.341459 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1326/2681] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:36 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:36.345779 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f1727-d81e-43bf-99c6-17a6bdcbcedb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:36.356261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f1727-d81e-43bf-99c6-17a6bdcbcedb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:36.360511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0fc69f-bcdb-4fd9-921f-2c00d5453f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:36.361103 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fc69f-bcdb-4fd9-921f-2c00d5453f81 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:36.361388 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fc69f-bcdb-4fd9-921f-2c00d5453f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:36.361709 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0fc69f-bcdb-4fd9-921f-2c00d5453f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:36.362402 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fc69f-bcdb-4fd9-921f-2c00d5453f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:36.389127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0fc69f-bcdb-4fd9-921f-2c00d5453f81 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:36.400065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1356/2682] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:36.404395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df557f5-1d38-49e0-95ac-b59b4e0f0350 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:36.414057 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df557f5-1d38-49e0-95ac-b59b4e0f0350 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:36.418964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139eb25-6dab-4062-a499-343272ee361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:36.419920 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139eb25-6dab-4062-a499-343272ee361d admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:36.420209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139eb25-6dab-4062-a499-343272ee361d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:36.420597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139eb25-6dab-4062-a499-343272ee361d admin admin] PATH_INFO: `/v3/projects/fc9dfd587a5c46cbaacfb690ca3e8976/users/14e4da45e26f4083812181653b827a41/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:36.441756 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139eb25-6dab-4062-a499-343272ee361d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9dfd587a5c46cbaacfb690ca3e8976, user_id=14e4da45e26f4083812181653b827a41, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:36.469345 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139eb25-6dab-4062-a499-343272ee361d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:36.542077 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1327/2683] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:36 2022] PUT /identity/v3/projects/fc9dfd587a5c46cbaacfb690ca3e8976/users/14e4da45e26f4083812181653b827a41/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:23:36.552544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a3b5e-370c-4a45-856f-68b1b98de150 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:36.552839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a3b5e-370c-4a45-856f-68b1b98de150 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:36.553124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a3b5e-370c-4a45-856f-68b1b98de150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:36.591482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c48a3b5e-370c-4a45-856f-68b1b98de150 None None] MFA Rules not processed for user `14e4da45e26f4083812181653b827a41`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:36.592639 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c48a3b5e-370c-4a45-856f-68b1b98de150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:36.667222 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1357/2684] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:36 2022] POST /identity/v3/auth/tokens => generated 3694 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:36.671563 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139eb25-6dab-4062-a499-343272ee361d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:36.741943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139eb25-6dab-4062-a499-343272ee361d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:36.746475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32d2f2-dff2-4187-af40-868ff2b4cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:36.747065 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32d2f2-dff2-4187-af40-868ff2b4cfba admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:36.747390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32d2f2-dff2-4187-af40-868ff2b4cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:36.747672 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32d2f2-dff2-4187-af40-868ff2b4cfba admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:36.748310 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32d2f2-dff2-4187-af40-868ff2b4cfba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:36.774015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32d2f2-dff2-4187-af40-868ff2b4cfba admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:36.931108 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1328/2685] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:36 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:36.935612 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a3b5e-370c-4a45-856f-68b1b98de150 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:36.946367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a3b5e-370c-4a45-856f-68b1b98de150 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:37.012265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d963d2-e1e5-422b-b9d0-10a585139aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:37.012865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d963d2-e1e5-422b-b9d0-10a585139aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:37.013162 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d963d2-e1e5-422b-b9d0-10a585139aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:37.013699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d963d2-e1e5-422b-b9d0-10a585139aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:37.014334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d963d2-e1e5-422b-b9d0-10a585139aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:37.041626 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d963d2-e1e5-422b-b9d0-10a585139aa4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:37.125671 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1358/2686] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:36 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:37.130086 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32d2f2-dff2-4187-af40-868ff2b4cfba admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:37.140493 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32d2f2-dff2-4187-af40-868ff2b4cfba admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:37.144871 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14158afa-e31d-40e8-806d-4b40b570e81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:37.145432 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14158afa-e31d-40e8-806d-4b40b570e81f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:37.145709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14158afa-e31d-40e8-806d-4b40b570e81f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:37.145992 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14158afa-e31d-40e8-806d-4b40b570e81f admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:37.146689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14158afa-e31d-40e8-806d-4b40b570e81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:37.174343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14158afa-e31d-40e8-806d-4b40b570e81f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:37.187591 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1329/2687] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:37.191577 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d963d2-e1e5-422b-b9d0-10a585139aa4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:37.201941 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d963d2-e1e5-422b-b9d0-10a585139aa4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:37.207031 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eec05-40fd-48d2-be8f-4e9b1fdfd173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:37.208335 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eec05-40fd-48d2-be8f-4e9b1fdfd173 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:37.208692 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eec05-40fd-48d2-be8f-4e9b1fdfd173 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:37.209080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eec05-40fd-48d2-be8f-4e9b1fdfd173 admin admin] PATH_INFO: `/v3/projects/1031723ea5c14142a5eebbe989b99a94/users/e0bb737a357541f49f9a4a3b559f2d41/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:37.235282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eec05-40fd-48d2-be8f-4e9b1fdfd173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1031723ea5c14142a5eebbe989b99a94, user_id=e0bb737a357541f49f9a4a3b559f2d41, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:37.262914 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eec05-40fd-48d2-be8f-4e9b1fdfd173 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:37.346843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1359/2688] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:37 2022] PUT /identity/v3/projects/1031723ea5c14142a5eebbe989b99a94/users/e0bb737a357541f49f9a4a3b559f2d41/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:23:37.350807 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14158afa-e31d-40e8-806d-4b40b570e81f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:37.361187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14158afa-e31d-40e8-806d-4b40b570e81f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:37.431153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f616d52-2344-4e4f-84a2-392105d4d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:37.435179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f616d52-2344-4e4f-84a2-392105d4d55f admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:37.435179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f616d52-2344-4e4f-84a2-392105d4d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:37.435179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f616d52-2344-4e4f-84a2-392105d4d55f admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:37.435179 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f616d52-2344-4e4f-84a2-392105d4d55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:37.459583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f616d52-2344-4e4f-84a2-392105d4d55f admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:37.471153 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1330/2689] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:37.475646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eec05-40fd-48d2-be8f-4e9b1fdfd173 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:37.488470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eec05-40fd-48d2-be8f-4e9b1fdfd173 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:37.490983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40d425-76a2-46d6-9b31-5c69325e07ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:37.491836 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40d425-76a2-46d6-9b31-5c69325e07ca admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:37.492127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40d425-76a2-46d6-9b31-5c69325e07ca admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:37.492409 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40d425-76a2-46d6-9b31-5c69325e07ca admin admin] PATH_INFO: `/v3/projects/1031723ea5c14142a5eebbe989b99a94/users/e0bb737a357541f49f9a4a3b559f2d41/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:37.494372 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40d425-76a2-46d6-9b31-5c69325e07ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1031723ea5c14142a5eebbe989b99a94, user_id=e0bb737a357541f49f9a4a3b559f2d41, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:37.521408 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40d425-76a2-46d6-9b31-5c69325e07ca admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:37.532569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1360/2690] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:37 2022] PUT /identity/v3/projects/1031723ea5c14142a5eebbe989b99a94/users/e0bb737a357541f49f9a4a3b559f2d41/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:23:37.536682 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f616d52-2344-4e4f-84a2-392105d4d55f admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:37.547352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f616d52-2344-4e4f-84a2-392105d4d55f admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:37.614584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326bd36a-d73c-4779-8e78-4bc7fdb0fd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:37.615184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd36a-d73c-4779-8e78-4bc7fdb0fd50 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:37.615550 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd36a-d73c-4779-8e78-4bc7fdb0fd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:37.615839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326bd36a-d73c-4779-8e78-4bc7fdb0fd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:37.616531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bd36a-d73c-4779-8e78-4bc7fdb0fd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:37.642778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326bd36a-d73c-4779-8e78-4bc7fdb0fd50 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:37.654334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1331/2691] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:37.658595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40d425-76a2-46d6-9b31-5c69325e07ca admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:37.668866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40d425-76a2-46d6-9b31-5c69325e07ca admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:37.673377 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a66cd-9be5-4c1f-8292-3e2b643a9d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:37.674192 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a66cd-9be5-4c1f-8292-3e2b643a9d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:37.674483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a66cd-9be5-4c1f-8292-3e2b643a9d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:37.674768 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a66cd-9be5-4c1f-8292-3e2b643a9d9c admin admin] PATH_INFO: `/v3/projects/1031723ea5c14142a5eebbe989b99a94/users/e0bb737a357541f49f9a4a3b559f2d41/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:37.676571 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a66cd-9be5-4c1f-8292-3e2b643a9d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1031723ea5c14142a5eebbe989b99a94, user_id=e0bb737a357541f49f9a4a3b559f2d41, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:37.704052 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a66cd-9be5-4c1f-8292-3e2b643a9d9c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:37.788238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1361/2692] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:37 2022] PUT /identity/v3/projects/1031723ea5c14142a5eebbe989b99a94/users/e0bb737a357541f49f9a4a3b559f2d41/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:37.800335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3d89a-0651-4e83-8b9e-dde330124671 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:37.800904 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3d89a-0651-4e83-8b9e-dde330124671 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:37.801014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3d89a-0651-4e83-8b9e-dde330124671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:37.839538 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-97b3d89a-0651-4e83-8b9e-dde330124671 None None] MFA Rules not processed for user `e0bb737a357541f49f9a4a3b559f2d41`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:37.840778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-97b3d89a-0651-4e83-8b9e-dde330124671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:37.920081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1332/2693] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:37 2022] POST /identity/v3/auth/tokens => generated 3759 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:37.930089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a66cd-9be5-4c1f-8292-3e2b643a9d9c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:37.931730 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a34a66cd-9be5-4c1f-8292-3e2b643a9d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:37.998120 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a66cd-9be5-4c1f-8292-3e2b643a9d9c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:38.001599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98c512-1138-439b-9fc6-9a7c80ff1204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:38.002174 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98c512-1138-439b-9fc6-9a7c80ff1204 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:38.002467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98c512-1138-439b-9fc6-9a7c80ff1204 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:38.002750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98c512-1138-439b-9fc6-9a7c80ff1204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:38.012211 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98c512-1138-439b-9fc6-9a7c80ff1204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:38.038542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98c512-1138-439b-9fc6-9a7c80ff1204 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:38.051670 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1362/2694] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:37 2022] GET /identity/v3/auth/tokens => generated 3759 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:38.077774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3d89a-0651-4e83-8b9e-dde330124671 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:38.149075 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3d89a-0651-4e83-8b9e-dde330124671 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:38.154132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:38.154928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:38.155209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:38.155520 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] PATH_INFO: `/v3/users/14e4da45e26f4083812181653b827a41` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:38.156802 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e4da45e26f4083812181653b827a41)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:38.183174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:38.325887 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e4da45e26f4083812181653b827a41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:38.337393 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e4da45e26f4083812181653b827a41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:38.338026 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e4da45e26f4083812181653b827a41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:38.346346 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e4da45e26f4083812181653b827a41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:38.397551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e4da45e26f4083812181653b827a41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:38.404450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1333/2695] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:38 2022] DELETE /identity/v3/users/14e4da45e26f4083812181653b827a41 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:38.409367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3715640-a5f2-44d7-84e2-e8979ef20e30 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:38.415659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3715640-a5f2-44d7-84e2-e8979ef20e30 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:38.415659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3715640-a5f2-44d7-84e2-e8979ef20e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:38.432043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-b3715640-a5f2-44d7-84e2-e8979ef20e30 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:38.433229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b3715640-a5f2-44d7-84e2-e8979ef20e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:38.500385 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1363/2696] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:38 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:38.511237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:38.512665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:38.585787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30d350-3f58-4cc7-a07f-1023ef14977a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:38.589093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639f9f9-14d5-44f2-b5d5-8d3a87b24759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:38.589673 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639f9f9-14d5-44f2-b5d5-8d3a87b24759 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:38.589951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639f9f9-14d5-44f2-b5d5-8d3a87b24759 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:38.590225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639f9f9-14d5-44f2-b5d5-8d3a87b24759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:38.599103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639f9f9-14d5-44f2-b5d5-8d3a87b24759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:38.625917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639f9f9-14d5-44f2-b5d5-8d3a87b24759 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:38.635895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1334/2697] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:38 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:39.167600 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3715640-a5f2-44d7-84e2-e8979ef20e30 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:39.170993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b3715640-a5f2-44d7-84e2-e8979ef20e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:39.180775 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3715640-a5f2-44d7-84e2-e8979ef20e30 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:39.185913 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:39.187028 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:39.187483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:39.188006 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] PATH_INFO: `/v3/projects/fc9dfd587a5c46cbaacfb690ca3e8976` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:39.189423 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9dfd587a5c46cbaacfb690ca3e8976)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:39.216431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:39.353720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9dfd587a5c46cbaacfb690ca3e8976', 'request_id': 'req-54c5aec2-6a56-41fd-972d-b447ec8bd66b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.437591 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9dfd587a5c46cbaacfb690ca3e8976', 'request_id': 'req-54c5aec2-6a56-41fd-972d-b447ec8bd66b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.449526 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9dfd587a5c46cbaacfb690ca3e8976', 'request_id': 'req-54c5aec2-6a56-41fd-972d-b447ec8bd66b'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.459624 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] The token cache is being invalidate because project fc9dfd587a5c46cbaacfb690ca3e8976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:39.459910 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.460560 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.462034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1364/2698] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:39 2022] DELETE /identity/v3/projects/fc9dfd587a5c46cbaacfb690ca3e8976 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:39.466837 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639f9f9-14d5-44f2-b5d5-8d3a87b24759 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:39.476163 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639f9f9-14d5-44f2-b5d5-8d3a87b24759 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:39.538622 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:39.545452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:39.545452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:39.545452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] PATH_INFO: `/v3/users/e0bb737a357541f49f9a4a3b559f2d41` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:39.545452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0bb737a357541f49f9a4a3b559f2d41)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:39.567052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:39.782744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0bb737a357541f49f9a4a3b559f2d41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.794882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0bb737a357541f49f9a4a3b559f2d41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.795541 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0bb737a357541f49f9a4a3b559f2d41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.803066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0bb737a357541f49f9a4a3b559f2d41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.929442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-63afb7f1-8c7d-4ad0-9c24-2c3ab1423225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0bb737a357541f49f9a4a3b559f2d41'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:39.936680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1335/2699] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:39 2022] DELETE /identity/v3/users/e0bb737a357541f49f9a4a3b559f2d41 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:40.456181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:40.458197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:40.472125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5aec2-6a56-41fd-972d-b447ec8bd66b admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:40.542587 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:40.543476 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:40.543728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:40.544006 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] PATH_INFO: `/v3/projects/1031723ea5c14142a5eebbe989b99a94` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:40.545125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1031723ea5c14142a5eebbe989b99a94)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:40.570837 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:40.695830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1031723ea5c14142a5eebbe989b99a94', 'request_id': 'req-24a4b1a8-c17b-4e73-a386-6954dfeec49d'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:40.803828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1031723ea5c14142a5eebbe989b99a94', 'request_id': 'req-24a4b1a8-c17b-4e73-a386-6954dfeec49d'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:40.821503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1031723ea5c14142a5eebbe989b99a94', 'request_id': 'req-24a4b1a8-c17b-4e73-a386-6954dfeec49d'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:40.833043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] The token cache is being invalidate because project 1031723ea5c14142a5eebbe989b99a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:40.833467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:40.834118 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-24a4b1a8-c17b-4e73-a386-6954dfeec49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:40.835580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1365/2700] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:40 2022] DELETE /identity/v3/projects/1031723ea5c14142a5eebbe989b99a94 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:40.843719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c38241-f65e-4ff2-9c8a-03d44fefd048 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:40.844208 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c38241-f65e-4ff2-9c8a-03d44fefd048 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:40.844325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c38241-f65e-4ff2-9c8a-03d44fefd048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:40.866383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-64c38241-f65e-4ff2-9c8a-03d44fefd048 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:40.867560 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-64c38241-f65e-4ff2-9c8a-03d44fefd048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:40.934426 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1336/2701] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:40.942453 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c3358-0a2f-405f-a5e2-2973e9d24145 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:40.942758 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c3358-0a2f-405f-a5e2-2973e9d24145 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:40.943035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994c3358-0a2f-405f-a5e2-2973e9d24145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:40.967054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-994c3358-0a2f-405f-a5e2-2973e9d24145 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:40.968247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-994c3358-0a2f-405f-a5e2-2973e9d24145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:40.975381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1366/2702] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:40 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:40.979750 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c38241-f65e-4ff2-9c8a-03d44fefd048 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:40.989134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c38241-f65e-4ff2-9c8a-03d44fefd048 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:40.993618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2a6e0-afc9-4bf1-86f4-0aacf1e37eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:40.994212 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2a6e0-afc9-4bf1-86f4-0aacf1e37eee admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:40.995043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2a6e0-afc9-4bf1-86f4-0aacf1e37eee admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:40.995735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2a6e0-afc9-4bf1-86f4-0aacf1e37eee admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:40.996133 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2a6e0-afc9-4bf1-86f4-0aacf1e37eee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:23:40.996434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2a6e0-afc9-4bf1-86f4-0aacf1e37eee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:41.022762 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2a6e0-afc9-4bf1-86f4-0aacf1e37eee admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:41.036276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1337/2703] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:23:41.040807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c3358-0a2f-405f-a5e2-2973e9d24145 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:41.049891 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994c3358-0a2f-405f-a5e2-2973e9d24145 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:41.054991 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562b7ea-0ba7-4a66-9513-c761a4a92f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:41.055546 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562b7ea-0ba7-4a66-9513-c761a4a92f35 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:41.055839 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562b7ea-0ba7-4a66-9513-c761a4a92f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:41.056158 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562b7ea-0ba7-4a66-9513-c761a4a92f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:41.056800 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562b7ea-0ba7-4a66-9513-c761a4a92f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:41.084673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562b7ea-0ba7-4a66-9513-c761a4a92f35 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:41.183629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1367/2704] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:41 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:41.187916 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2a6e0-afc9-4bf1-86f4-0aacf1e37eee admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:41.198343 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2a6e0-afc9-4bf1-86f4-0aacf1e37eee admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:41.265913 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35368c-d1fc-4538-b4e1-0736557050b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:41.266527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35368c-d1fc-4538-b4e1-0736557050b8 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:41.266817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35368c-d1fc-4538-b4e1-0736557050b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:41.267103 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a35368c-d1fc-4538-b4e1-0736557050b8 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:41.267793 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35368c-d1fc-4538-b4e1-0736557050b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:41.293680 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a35368c-d1fc-4538-b4e1-0736557050b8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:41.423774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1338/2705] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:41 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:23:41.427691 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562b7ea-0ba7-4a66-9513-c761a4a92f35 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:41.439154 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562b7ea-0ba7-4a66-9513-c761a4a92f35 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:41.443659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c6081-43fe-4aa1-9ee7-65eb50e98404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:41.444285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6081-43fe-4aa1-9ee7-65eb50e98404 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:41.444567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6081-43fe-4aa1-9ee7-65eb50e98404 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:41.444850 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c6081-43fe-4aa1-9ee7-65eb50e98404 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:41.445541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c6081-43fe-4aa1-9ee7-65eb50e98404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:41.472065 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c6081-43fe-4aa1-9ee7-65eb50e98404 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:41.483758 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1368/2706] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:23:41.487858 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35368c-d1fc-4538-b4e1-0736557050b8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:41.498294 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a35368c-d1fc-4538-b4e1-0736557050b8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:41.503078 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389cf44-0cea-4aff-bee1-3a4251ddbc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:41.504005 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389cf44-0cea-4aff-bee1-3a4251ddbc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:41.504298 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389cf44-0cea-4aff-bee1-3a4251ddbc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:41.504586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389cf44-0cea-4aff-bee1-3a4251ddbc3a admin admin] PATH_INFO: `/v3/projects/eedeaba076e2493cacfa3e1ddbec8da1/users/7f1b959799b949b0988f4cb170cb7472/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:41.527151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389cf44-0cea-4aff-bee1-3a4251ddbc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedeaba076e2493cacfa3e1ddbec8da1, user_id=7f1b959799b949b0988f4cb170cb7472, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:41.554102 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389cf44-0cea-4aff-bee1-3a4251ddbc3a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:41.622046 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1339/2707] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:41 2022] PUT /identity/v3/projects/eedeaba076e2493cacfa3e1ddbec8da1/users/7f1b959799b949b0988f4cb170cb7472/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:41.632355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f83ebd-ae8c-4c90-99e3-293d1a2a7bb1 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:41.632990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f83ebd-ae8c-4c90-99e3-293d1a2a7bb1 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:41.633477 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f83ebd-ae8c-4c90-99e3-293d1a2a7bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:41.672491 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a6f83ebd-ae8c-4c90-99e3-293d1a2a7bb1 None None] MFA Rules not processed for user `7f1b959799b949b0988f4cb170cb7472`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:41.673721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a6f83ebd-ae8c-4c90-99e3-293d1a2a7bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:41.757143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1369/2708] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:41 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:41.764185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389cf44-0cea-4aff-bee1-3a4251ddbc3a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:41.766032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1389cf44-0cea-4aff-bee1-3a4251ddbc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:41.840619 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389cf44-0cea-4aff-bee1-3a4251ddbc3a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:41.844021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc09ace-b9a1-4e5f-931b-a622aec53df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:41.844740 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc09ace-b9a1-4e5f-931b-a622aec53df0 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:41.845019 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc09ace-b9a1-4e5f-931b-a622aec53df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:41.845296 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc09ace-b9a1-4e5f-931b-a622aec53df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:41.854817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc09ace-b9a1-4e5f-931b-a622aec53df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:41.881953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc09ace-b9a1-4e5f-931b-a622aec53df0 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:41.892670 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1340/2709] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:41 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:41.913861 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f83ebd-ae8c-4c90-99e3-293d1a2a7bb1 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:41.989634 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f83ebd-ae8c-4c90-99e3-293d1a2a7bb1 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:41.993971 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:41.995330 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:41.995642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:41.996127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] PATH_INFO: `/v3/users/7f1b959799b949b0988f4cb170cb7472` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:41.997283 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1b959799b949b0988f4cb170cb7472)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:42.030807 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:42.234609 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1b959799b949b0988f4cb170cb7472'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:42.235836 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1b959799b949b0988f4cb170cb7472'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:42.243857 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1b959799b949b0988f4cb170cb7472'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:42.257130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1b959799b949b0988f4cb170cb7472'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:42.387337 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1b959799b949b0988f4cb170cb7472'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:42.394556 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1370/2710] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:41 2022] DELETE /identity/v3/users/7f1b959799b949b0988f4cb170cb7472 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:42.399207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2171db-e990-48ec-93c6-d48ddefe12be None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:42.399570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2171db-e990-48ec-93c6-d48ddefe12be None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:42.399977 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2171db-e990-48ec-93c6-d48ddefe12be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:42.423556 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-db2171db-e990-48ec-93c6-d48ddefe12be None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:42.424706 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-db2171db-e990-48ec-93c6-d48ddefe12be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:42.491406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1341/2711] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:42 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:42.502497 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:42.503997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:42.571507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2ec7c-109c-4167-9ef6-bedcd716aa90 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:42.575544 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd2454-22e4-4f40-9f40-71eacc57ac57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:42.576126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2454-22e4-4f40-9f40-71eacc57ac57 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:42.576414 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2454-22e4-4f40-9f40-71eacc57ac57 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:42.576690 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd2454-22e4-4f40-9f40-71eacc57ac57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:42.585936 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd2454-22e4-4f40-9f40-71eacc57ac57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:42.611488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd2454-22e4-4f40-9f40-71eacc57ac57 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:42.622217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1371/2712] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:42 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:43.152798 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2171db-e990-48ec-93c6-d48ddefe12be None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:43.154189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-db2171db-e990-48ec-93c6-d48ddefe12be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:43.169472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2171db-e990-48ec-93c6-d48ddefe12be None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:43.174751 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:43.175584 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:43.175869 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:43.176144 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] PATH_INFO: `/v3/projects/eedeaba076e2493cacfa3e1ddbec8da1` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:43.178041 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eedeaba076e2493cacfa3e1ddbec8da1)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:43.207390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:43.352365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eedeaba076e2493cacfa3e1ddbec8da1', 'request_id': 'req-66ca1869-8e82-408e-a37e-336d9bc3ec7a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:43.420704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eedeaba076e2493cacfa3e1ddbec8da1', 'request_id': 'req-66ca1869-8e82-408e-a37e-336d9bc3ec7a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:43.433521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eedeaba076e2493cacfa3e1ddbec8da1', 'request_id': 'req-66ca1869-8e82-408e-a37e-336d9bc3ec7a'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:43.444602 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] The token cache is being invalidate because project eedeaba076e2493cacfa3e1ddbec8da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:43.444890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:43.445732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:43.447138 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1342/2713] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:43 2022] DELETE /identity/v3/projects/eedeaba076e2493cacfa3e1ddbec8da1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:45.388371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd2454-22e4-4f40-9f40-71eacc57ac57 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:45.389849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-58dd2454-22e4-4f40-9f40-71eacc57ac57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:45.401917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd2454-22e4-4f40-9f40-71eacc57ac57 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:45.472040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:45.472862 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:45.473151 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:45.473438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] PATH_INFO: `/v3/users/97c52c057d224ee7a96de5f14c710c0c` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:45.474548 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c52c057d224ee7a96de5f14c710c0c)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:45.501720 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:45.674170 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c52c057d224ee7a96de5f14c710c0c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:45.674767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c52c057d224ee7a96de5f14c710c0c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:45.682678 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c52c057d224ee7a96de5f14c710c0c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:45.694764 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c52c057d224ee7a96de5f14c710c0c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:45.775191 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-8977f427-5c64-483a-86f8-1d3479a6e0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c52c057d224ee7a96de5f14c710c0c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:45.782432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1372/2714] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:45 2022] DELETE /identity/v3/users/97c52c057d224ee7a96de5f14c710c0c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:46.077203 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:46.081151 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:46.093978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca1869-8e82-408e-a37e-336d9bc3ec7a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:46.160779 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:46.161569 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:46.161885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:46.162166 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] PATH_INFO: `/v3/projects/15b6d9d1b82a4911978cd65518e7677f` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:46.163243 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b6d9d1b82a4911978cd65518e7677f)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:46.190566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:46.324429 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b6d9d1b82a4911978cd65518e7677f', 'request_id': 'req-d4ece073-fa97-4c73-a763-5546e32ec6fa'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:46.403220 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b6d9d1b82a4911978cd65518e7677f', 'request_id': 'req-d4ece073-fa97-4c73-a763-5546e32ec6fa'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:46.415217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b6d9d1b82a4911978cd65518e7677f', 'request_id': 'req-d4ece073-fa97-4c73-a763-5546e32ec6fa'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:46.426318 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] The token cache is being invalidate because project 15b6d9d1b82a4911978cd65518e7677f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:46.426596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:46.427215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-d4ece073-fa97-4c73-a763-5546e32ec6fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:46.428664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1343/2715] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:46 2022] DELETE /identity/v3/projects/15b6d9d1b82a4911978cd65518e7677f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:23:46.434685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682c67-b602-4b28-8ce7-76c880b4a45e None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:46.435205 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682c67-b602-4b28-8ce7-76c880b4a45e None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:46.435419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9682c67-b602-4b28-8ce7-76c880b4a45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:46.458809 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a9682c67-b602-4b28-8ce7-76c880b4a45e None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:46.459983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a9682c67-b602-4b28-8ce7-76c880b4a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:46.533801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1373/2716] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:46.547559 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017925ca-ccc5-4404-a83d-c17f2b08a14f None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:46.547849 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017925ca-ccc5-4404-a83d-c17f2b08a14f None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:46.548135 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017925ca-ccc5-4404-a83d-c17f2b08a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:46.570621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-017925ca-ccc5-4404-a83d-c17f2b08a14f None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:46.571821 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-017925ca-ccc5-4404-a83d-c17f2b08a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:46.579960 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1344/2717] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:46 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:46.584371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9682c67-b602-4b28-8ce7-76c880b4a45e None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:46.594568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9682c67-b602-4b28-8ce7-76c880b4a45e None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:46.598932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf352063-3c64-4a61-b205-729b7c4edb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:46.599633 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf352063-3c64-4a61-b205-729b7c4edb56 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:46.599902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf352063-3c64-4a61-b205-729b7c4edb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:46.600187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf352063-3c64-4a61-b205-729b7c4edb56 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:46.600877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf352063-3c64-4a61-b205-729b7c4edb56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:23:46.601182 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf352063-3c64-4a61-b205-729b7c4edb56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:46.627029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf352063-3c64-4a61-b205-729b7c4edb56 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:46.641886 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1374/2718] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:23:46.646249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017925ca-ccc5-4404-a83d-c17f2b08a14f None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:46.655863 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017925ca-ccc5-4404-a83d-c17f2b08a14f None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:46.660308 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8800c-1242-45ca-bdc6-107af0355cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:46.660895 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8800c-1242-45ca-bdc6-107af0355cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:46.661182 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8800c-1242-45ca-bdc6-107af0355cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:46.661465 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8800c-1242-45ca-bdc6-107af0355cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:46.662104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8800c-1242-45ca-bdc6-107af0355cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:46.688533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8800c-1242-45ca-bdc6-107af0355cb5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:46.788399 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1345/2719] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:46 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:23:46.792980 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf352063-3c64-4a61-b205-729b7c4edb56 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:46.803661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf352063-3c64-4a61-b205-729b7c4edb56 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:46.870354 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0af0f1-91dc-478a-a1b5-e83202feb1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:46.870979 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0af0f1-91dc-478a-a1b5-e83202feb1d9 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:46.871278 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0af0f1-91dc-478a-a1b5-e83202feb1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:46.871582 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0af0f1-91dc-478a-a1b5-e83202feb1d9 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:46.872204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0af0f1-91dc-478a-a1b5-e83202feb1d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:46.909223 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0af0f1-91dc-478a-a1b5-e83202feb1d9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:47.061907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1375/2720] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:46 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:47.066024 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8800c-1242-45ca-bdc6-107af0355cb5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:47.077118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8800c-1242-45ca-bdc6-107af0355cb5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:47.081031 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d1ce1-7050-489c-88cd-6e392aeae515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:47.081643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1ce1-7050-489c-88cd-6e392aeae515 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:47.081933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1ce1-7050-489c-88cd-6e392aeae515 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:47.082174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d1ce1-7050-489c-88cd-6e392aeae515 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:47.082876 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d1ce1-7050-489c-88cd-6e392aeae515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:47.109139 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d1ce1-7050-489c-88cd-6e392aeae515 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:47.121007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1346/2721] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:47.126048 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0af0f1-91dc-478a-a1b5-e83202feb1d9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:47.136942 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0af0f1-91dc-478a-a1b5-e83202feb1d9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:47.141410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a360-4344-4895-b90c-482cf177ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:47.142216 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a360-4344-4895-b90c-482cf177ef90 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:47.142496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a360-4344-4895-b90c-482cf177ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:47.142767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962a360-4344-4895-b90c-482cf177ef90 admin admin] PATH_INFO: `/v3/projects/68a4241bade64e18be92f917145a20c7/users/fb513fb5c8c34b448716ae64fd8ad268/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:47.163062 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a360-4344-4895-b90c-482cf177ef90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a4241bade64e18be92f917145a20c7, user_id=fb513fb5c8c34b448716ae64fd8ad268, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:47.190338 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962a360-4344-4895-b90c-482cf177ef90 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:47.273110 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1376/2722] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:47 2022] PUT /identity/v3/projects/68a4241bade64e18be92f917145a20c7/users/fb513fb5c8c34b448716ae64fd8ad268/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:47.283435 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed15cf8-9c29-4ee1-9b81-e4c0ec5d3a5b None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:47.283732 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed15cf8-9c29-4ee1-9b81-e4c0ec5d3a5b None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:47.284013 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed15cf8-9c29-4ee1-9b81-e4c0ec5d3a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:47.324355 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-5ed15cf8-9c29-4ee1-9b81-e4c0ec5d3a5b None None] MFA Rules not processed for user `fb513fb5c8c34b448716ae64fd8ad268`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:47.325479 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-5ed15cf8-9c29-4ee1-9b81-e4c0ec5d3a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:47.400474 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1347/2723] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:47 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:47.411481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a360-4344-4895-b90c-482cf177ef90 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:47.413193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d962a360-4344-4895-b90c-482cf177ef90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:47.493143 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962a360-4344-4895-b90c-482cf177ef90 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:47.499099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d3c8d-3745-4900-ad49-189026ea0e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:47.499710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d3c8d-3745-4900-ad49-189026ea0e1b service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:47.500004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d3c8d-3745-4900-ad49-189026ea0e1b service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:47.500284 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d3c8d-3745-4900-ad49-189026ea0e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:47.508564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d3c8d-3745-4900-ad49-189026ea0e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:47.538703 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d3c8d-3745-4900-ad49-189026ea0e1b service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:47.549011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1377/2724] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:47 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:51.181992 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed15cf8-9c29-4ee1-9b81-e4c0ec5d3a5b None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:51.253509 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed15cf8-9c29-4ee1-9b81-e4c0ec5d3a5b None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:51.257755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:51.258583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:51.258891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:51.259149 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] PATH_INFO: `/v3/users/fb513fb5c8c34b448716ae64fd8ad268` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:51.260274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb513fb5c8c34b448716ae64fd8ad268)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:51.286900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:51.480759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb513fb5c8c34b448716ae64fd8ad268'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:51.493069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb513fb5c8c34b448716ae64fd8ad268'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:51.493725 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb513fb5c8c34b448716ae64fd8ad268'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:51.501496 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb513fb5c8c34b448716ae64fd8ad268'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:51.575263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb513fb5c8c34b448716ae64fd8ad268'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:51.582055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1348/2725] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:23:51 2022] DELETE /identity/v3/users/fb513fb5c8c34b448716ae64fd8ad268 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:51.587732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a890e-606c-49d4-843c-891f5f20700b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:51.588249 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a890e-606c-49d4-843c-891f5f20700b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:51.588583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a890e-606c-49d4-843c-891f5f20700b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:51.619732 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-2c6a890e-606c-49d4-843c-891f5f20700b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:51.621552 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2c6a890e-606c-49d4-843c-891f5f20700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:51.690091 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1378/2726] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:51 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:51.700549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:51.701949 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:51.766665 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a761e-a936-4ce0-81dc-da3ece14d892 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:51.770264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540edf1-7e24-4ce8-a18a-49b05fae3b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:51.770844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540edf1-7e24-4ce8-a18a-49b05fae3b80 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:51.771125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540edf1-7e24-4ce8-a18a-49b05fae3b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:51.771439 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540edf1-7e24-4ce8-a18a-49b05fae3b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:51.781007 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540edf1-7e24-4ce8-a18a-49b05fae3b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:51.806944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540edf1-7e24-4ce8-a18a-49b05fae3b80 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:51.816528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1349/2727] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:52.368722 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a890e-606c-49d4-843c-891f5f20700b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:52.370073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-2c6a890e-606c-49d4-843c-891f5f20700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:52.383507 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a890e-606c-49d4-843c-891f5f20700b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:52.389463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:52.390250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:52.390541 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:52.390859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] PATH_INFO: `/v3/projects/68a4241bade64e18be92f917145a20c7` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:52.391952 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a4241bade64e18be92f917145a20c7)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:52.418366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:52.524072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a4241bade64e18be92f917145a20c7', 'request_id': 'req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:52.608924 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a4241bade64e18be92f917145a20c7', 'request_id': 'req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:52.620531 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a4241bade64e18be92f917145a20c7', 'request_id': 'req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:52.630988 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] The token cache is being invalidate because project 68a4241bade64e18be92f917145a20c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:23:52.631282 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:52.631939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-557f86dc-16b3-4c1c-8207-0a2f32f1dde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:23:52.633355 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1379/2728] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:23:52 2022] DELETE /identity/v3/projects/68a4241bade64e18be92f917145a20c7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:52.639759 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98651-d6db-493a-820b-a5bb3c12c6c8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:52.640237 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98651-d6db-493a-820b-a5bb3c12c6c8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:52.640334 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc98651-d6db-493a-820b-a5bb3c12c6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:52.663256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-2fc98651-d6db-493a-820b-a5bb3c12c6c8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:52.664431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-2fc98651-d6db-493a-820b-a5bb3c12c6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:52.733517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1350/2729] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:52.741289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888acf5e-4250-4b61-91ae-22436f339580 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:52.741583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888acf5e-4250-4b61-91ae-22436f339580 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:52.741868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888acf5e-4250-4b61-91ae-22436f339580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:52.766811 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-888acf5e-4250-4b61-91ae-22436f339580 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:52.768004 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-888acf5e-4250-4b61-91ae-22436f339580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:52.775148 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1380/2730] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:52 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:52.779706 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc98651-d6db-493a-820b-a5bb3c12c6c8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:52.789160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc98651-d6db-493a-820b-a5bb3c12c6c8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:52.794716 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bedb8-a7c8-41f7-96ca-b984004a10ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:52.800631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bedb8-a7c8-41f7-96ca-b984004a10ce admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:52.800631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bedb8-a7c8-41f7-96ca-b984004a10ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:52.800631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bedb8-a7c8-41f7-96ca-b984004a10ce admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:52.800631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bedb8-a7c8-41f7-96ca-b984004a10ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:23:52.800631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bedb8-a7c8-41f7-96ca-b984004a10ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:52.823193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bedb8-a7c8-41f7-96ca-b984004a10ce admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:52.838788 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1351/2731] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:23:52.843569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888acf5e-4250-4b61-91ae-22436f339580 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:52.852320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888acf5e-4250-4b61-91ae-22436f339580 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:52.857655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0a0bc-b43e-4ba2-89b7-9399d1b9d889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:52.860238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0a0bc-b43e-4ba2-89b7-9399d1b9d889 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:52.860238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0a0bc-b43e-4ba2-89b7-9399d1b9d889 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:52.860238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e0a0bc-b43e-4ba2-89b7-9399d1b9d889 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:52.860238 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0a0bc-b43e-4ba2-89b7-9399d1b9d889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:52.885632 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e0a0bc-b43e-4ba2-89b7-9399d1b9d889 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:52.983337 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1381/2732] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:52 2022] POST /identity/v3/projects => generated 393 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:52.988757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bedb8-a7c8-41f7-96ca-b984004a10ce admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:52.998971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bedb8-a7c8-41f7-96ca-b984004a10ce admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:53.070140 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875ab1d-7126-40ad-b6bc-a6f0ba9dd91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:53.070805 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875ab1d-7126-40ad-b6bc-a6f0ba9dd91d admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:53.071092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875ab1d-7126-40ad-b6bc-a6f0ba9dd91d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:53.071404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875ab1d-7126-40ad-b6bc-a6f0ba9dd91d admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:53.072064 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875ab1d-7126-40ad-b6bc-a6f0ba9dd91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:53.098549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875ab1d-7126-40ad-b6bc-a6f0ba9dd91d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:53.170618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1352/2733] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:52 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:53.175172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0a0bc-b43e-4ba2-89b7-9399d1b9d889 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:53.185702 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e0a0bc-b43e-4ba2-89b7-9399d1b9d889 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:53.190111 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d24a7b-4d19-465f-abe0-f8dc5de6d2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:53.190709 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d24a7b-4d19-465f-abe0-f8dc5de6d2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:53.190995 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d24a7b-4d19-465f-abe0-f8dc5de6d2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:53.191273 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d24a7b-4d19-465f-abe0-f8dc5de6d2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:53.192059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d24a7b-4d19-465f-abe0-f8dc5de6d2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:53.218200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d24a7b-4d19-465f-abe0-f8dc5de6d2b6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:53.229366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1382/2734] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:53.234820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875ab1d-7126-40ad-b6bc-a6f0ba9dd91d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:53.244596 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875ab1d-7126-40ad-b6bc-a6f0ba9dd91d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:53.249527 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae02eb-fd93-4a28-829b-187c5bf56821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:53.250351 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae02eb-fd93-4a28-829b-187c5bf56821 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:53.250631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae02eb-fd93-4a28-829b-187c5bf56821 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:53.250905 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae02eb-fd93-4a28-829b-187c5bf56821 admin admin] PATH_INFO: `/v3/projects/647ea31792be49c7a4fb69bf20652362/users/b62f50d8edb74ceabc5c691b2a4e76c9/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:53.271383 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae02eb-fd93-4a28-829b-187c5bf56821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647ea31792be49c7a4fb69bf20652362, user_id=b62f50d8edb74ceabc5c691b2a4e76c9, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:53.298926 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae02eb-fd93-4a28-829b-187c5bf56821 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:53.358714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1353/2735] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:53 2022] PUT /identity/v3/projects/647ea31792be49c7a4fb69bf20652362/users/b62f50d8edb74ceabc5c691b2a4e76c9/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:53.369181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5595d0-b266-4579-b73d-ca6592245a4d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:53.369367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5595d0-b266-4579-b73d-ca6592245a4d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:53.369650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5595d0-b266-4579-b73d-ca6592245a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:53.413401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-6b5595d0-b266-4579-b73d-ca6592245a4d None None] MFA Rules not processed for user `b62f50d8edb74ceabc5c691b2a4e76c9`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:53.414564 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-6b5595d0-b266-4579-b73d-ca6592245a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:53.491705 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1383/2736] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:53 2022] POST /identity/v3/auth/tokens => generated 3700 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:53.496530 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae02eb-fd93-4a28-829b-187c5bf56821 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:53.567207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae02eb-fd93-4a28-829b-187c5bf56821 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:53.571769 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c844a35-a64a-4003-9d2d-265e7c63573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:53.572365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c844a35-a64a-4003-9d2d-265e7c63573c admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:53.572653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c844a35-a64a-4003-9d2d-265e7c63573c admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:53.572930 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c844a35-a64a-4003-9d2d-265e7c63573c admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:53.573585 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c844a35-a64a-4003-9d2d-265e7c63573c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:53.601255 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c844a35-a64a-4003-9d2d-265e7c63573c admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:53.731238 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1354/2737] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:23:53 2022] POST /identity/v3/projects => generated 393 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:23:53.735438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5595d0-b266-4579-b73d-ca6592245a4d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:53.746388 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5595d0-b266-4579-b73d-ca6592245a4d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:53.813599 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac0b83-85b4-45b7-a44a-d522dd13b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:53.814370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac0b83-85b4-45b7-a44a-d522dd13b8cf admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:53.814583 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac0b83-85b4-45b7-a44a-d522dd13b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:53.814867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac0b83-85b4-45b7-a44a-d522dd13b8cf admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:53.815555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac0b83-85b4-45b7-a44a-d522dd13b8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:53.842996 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac0b83-85b4-45b7-a44a-d522dd13b8cf admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:53.929993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1384/2738] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:23:53 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:23:53.934631 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c844a35-a64a-4003-9d2d-265e7c63573c admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:53.944687 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c844a35-a64a-4003-9d2d-265e7c63573c admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:53.949494 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cbd07-27ff-4f3f-bae2-c1da838e2e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:53.950259 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cbd07-27ff-4f3f-bae2-c1da838e2e10 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:53.950589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cbd07-27ff-4f3f-bae2-c1da838e2e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:53.950869 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cbd07-27ff-4f3f-bae2-c1da838e2e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:53.951603 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cbd07-27ff-4f3f-bae2-c1da838e2e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:53.977011 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cbd07-27ff-4f3f-bae2-c1da838e2e10 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:53.988709 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1355/2739] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:53.992830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac0b83-85b4-45b7-a44a-d522dd13b8cf admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:54.003253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac0b83-85b4-45b7-a44a-d522dd13b8cf admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:54.007869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b2cb2-2541-41ba-bbfc-09690d15fe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:54.008782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b2cb2-2541-41ba-bbfc-09690d15fe5e admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:54.009078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b2cb2-2541-41ba-bbfc-09690d15fe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:54.009296 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b2cb2-2541-41ba-bbfc-09690d15fe5e admin admin] PATH_INFO: `/v3/projects/4ecb52f353084182b1324dc3352fdf84/users/3f0bf5f2ee0c4f93ba779b2b9a001241/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:54.031645 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b2cb2-2541-41ba-bbfc-09690d15fe5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecb52f353084182b1324dc3352fdf84, user_id=3f0bf5f2ee0c4f93ba779b2b9a001241, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:54.060044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b2cb2-2541-41ba-bbfc-09690d15fe5e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:54.141688 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1385/2740] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:53 2022] PUT /identity/v3/projects/4ecb52f353084182b1324dc3352fdf84/users/3f0bf5f2ee0c4f93ba779b2b9a001241/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:54.145980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cbd07-27ff-4f3f-bae2-c1da838e2e10 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:54.156198 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cbd07-27ff-4f3f-bae2-c1da838e2e10 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:54.218786 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b0a34-c292-4b00-a19b-c090cc7ccfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:54.219407 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0a34-c292-4b00-a19b-c090cc7ccfde admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:54.219700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0a34-c292-4b00-a19b-c090cc7ccfde admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:54.219986 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0a34-c292-4b00-a19b-c090cc7ccfde admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:54.220679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b0a34-c292-4b00-a19b-c090cc7ccfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:54.247521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b0a34-c292-4b00-a19b-c090cc7ccfde admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:54.257860 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1356/2741] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:54.262236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b2cb2-2541-41ba-bbfc-09690d15fe5e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:54.272254 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b2cb2-2541-41ba-bbfc-09690d15fe5e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:54.276478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843066ae-37db-4f91-b301-5f7376b0bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:54.277579 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843066ae-37db-4f91-b301-5f7376b0bb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:54.277863 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843066ae-37db-4f91-b301-5f7376b0bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:54.278144 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843066ae-37db-4f91-b301-5f7376b0bb6d admin admin] PATH_INFO: `/v3/projects/4ecb52f353084182b1324dc3352fdf84/users/3f0bf5f2ee0c4f93ba779b2b9a001241/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:54.279920 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843066ae-37db-4f91-b301-5f7376b0bb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecb52f353084182b1324dc3352fdf84, user_id=3f0bf5f2ee0c4f93ba779b2b9a001241, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:54.306964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843066ae-37db-4f91-b301-5f7376b0bb6d admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:54.317642 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1386/2742] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:54 2022] PUT /identity/v3/projects/4ecb52f353084182b1324dc3352fdf84/users/3f0bf5f2ee0c4f93ba779b2b9a001241/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:54.321614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b0a34-c292-4b00-a19b-c090cc7ccfde admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:54.331287 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b0a34-c292-4b00-a19b-c090cc7ccfde admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:54.394586 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16957d9-93b4-4441-966d-584ac8dcc7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:54.395189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16957d9-93b4-4441-966d-584ac8dcc7ae admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:54.395502 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16957d9-93b4-4441-966d-584ac8dcc7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:54.395787 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16957d9-93b4-4441-966d-584ac8dcc7ae admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:54.396476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16957d9-93b4-4441-966d-584ac8dcc7ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:54.422943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16957d9-93b4-4441-966d-584ac8dcc7ae admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:54.433437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1357/2743] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:23:54.437859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843066ae-37db-4f91-b301-5f7376b0bb6d admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:54.447656 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843066ae-37db-4f91-b301-5f7376b0bb6d admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:54.452250 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff206-f29d-46d0-82a0-8a53146409f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:54.453099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff206-f29d-46d0-82a0-8a53146409f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:54.453436 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff206-f29d-46d0-82a0-8a53146409f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:54.453716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ff206-f29d-46d0-82a0-8a53146409f8 admin admin] PATH_INFO: `/v3/projects/4ecb52f353084182b1324dc3352fdf84/users/3f0bf5f2ee0c4f93ba779b2b9a001241/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:54.455658 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ff206-f29d-46d0-82a0-8a53146409f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecb52f353084182b1324dc3352fdf84, user_id=3f0bf5f2ee0c4f93ba779b2b9a001241, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:54.484784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ff206-f29d-46d0-82a0-8a53146409f8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:54.576306 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1387/2744] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:23:54 2022] PUT /identity/v3/projects/4ecb52f353084182b1324dc3352fdf84/users/3f0bf5f2ee0c4f93ba779b2b9a001241/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:23:54.588112 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef215d-50a3-4796-b4b9-ca4cfd0a3a8d None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:54.588408 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef215d-50a3-4796-b4b9-ca4cfd0a3a8d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:54.588700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef215d-50a3-4796-b4b9-ca4cfd0a3a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:54.627455 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ddef215d-50a3-4796-b4b9-ca4cfd0a3a8d None None] MFA Rules not processed for user `3f0bf5f2ee0c4f93ba779b2b9a001241`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:23:54.628616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ddef215d-50a3-4796-b4b9-ca4cfd0a3a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:54.705193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1358/2745] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:23:54 2022] POST /identity/v3/auth/tokens => generated 3767 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:23:54.715066 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff206-f29d-46d0-82a0-8a53146409f8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:54.716805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-ec9ff206-f29d-46d0-82a0-8a53146409f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:54.779901 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ff206-f29d-46d0-82a0-8a53146409f8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:54.783266 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaa3ee-7293-4261-846c-94993adb63e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:54.783867 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaa3ee-7293-4261-846c-94993adb63e6 service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:54.784153 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaa3ee-7293-4261-846c-94993adb63e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:54.784450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaa3ee-7293-4261-846c-94993adb63e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:54.794005 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaa3ee-7293-4261-846c-94993adb63e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:54.819298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaa3ee-7293-4261-846c-94993adb63e6 service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:54.829442 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1388/2746] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:54 2022] GET /identity/v3/auth/tokens => generated 3767 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:23:54.876445 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef215d-50a3-4796-b4b9-ca4cfd0a3a8d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:23:54.877856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ddef215d-50a3-4796-b4b9-ca4cfd0a3a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:23:54.891409 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef215d-50a3-4796-b4b9-ca4cfd0a3a8d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:23:54.894981 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bbb080-97f2-470e-8662-01b5128fc649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:23:54.896293 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb080-97f2-470e-8662-01b5128fc649 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:23:54.896583 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb080-97f2-470e-8662-01b5128fc649 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:23:54.897266 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbb080-97f2-470e-8662-01b5128fc649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:23:54.966532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbb080-97f2-470e-8662-01b5128fc649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:23:54.999408 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bbb080-97f2-470e-8662-01b5128fc649 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:23:55.008929 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1359/2747] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:23:54 2022] GET /identity/v3/auth/tokens => generated 3700 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:00.279481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaa3ee-7293-4261-846c-94993adb63e6 service cinder] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:00.360073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaa3ee-7293-4261-846c-94993adb63e6 service cinder] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:00.365188 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:00.366009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:00.366297 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:00.366606 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] PATH_INFO: `/v3/users/b62f50d8edb74ceabc5c691b2a4e76c9` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:00.374129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62f50d8edb74ceabc5c691b2a4e76c9)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:00.396943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:00.612482 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62f50d8edb74ceabc5c691b2a4e76c9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:00.613244 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62f50d8edb74ceabc5c691b2a4e76c9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:00.624298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62f50d8edb74ceabc5c691b2a4e76c9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:00.636208 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62f50d8edb74ceabc5c691b2a4e76c9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:00.712126 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62f50d8edb74ceabc5c691b2a4e76c9'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:00.720345 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1389/2748] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:24:00 2022] DELETE /identity/v3/users/b62f50d8edb74ceabc5c691b2a4e76c9 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:00.725714 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037521-57a3-4acc-901d-489e4d2cf057 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:00.731551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037521-57a3-4acc-901d-489e4d2cf057 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:00.731551 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29037521-57a3-4acc-901d-489e4d2cf057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:00.752316 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-29037521-57a3-4acc-901d-489e4d2cf057 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:00.753511 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-29037521-57a3-4acc-901d-489e4d2cf057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:00.836928 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1360/2749] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:00 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:00.849562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:00.850987 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:00.920463 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce86b5b-6d18-4e6e-ac80-b002602e39bb admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:00.924298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8baf38-5b2d-433d-9237-62914bdd54ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:00.924881 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8baf38-5b2d-433d-9237-62914bdd54ac service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:00.925176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8baf38-5b2d-433d-9237-62914bdd54ac service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:00.925460 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8baf38-5b2d-433d-9237-62914bdd54ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:00.935169 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8baf38-5b2d-433d-9237-62914bdd54ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:00.961607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8baf38-5b2d-433d-9237-62914bdd54ac service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:00.971969 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1390/2750] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:00 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:01.490169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037521-57a3-4acc-901d-489e4d2cf057 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:01.491576 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-29037521-57a3-4acc-901d-489e4d2cf057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:01.503431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29037521-57a3-4acc-901d-489e4d2cf057 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:01.509885 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:01.510696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:01.510995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:01.511839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] PATH_INFO: `/v3/projects/647ea31792be49c7a4fb69bf20652362` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:01.514971 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=647ea31792be49c7a4fb69bf20652362)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:01.544062 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:01.671091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647ea31792be49c7a4fb69bf20652362', 'request_id': 'req-f461da3a-9f9a-4db3-8050-a63341d55457'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:01.752248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647ea31792be49c7a4fb69bf20652362', 'request_id': 'req-f461da3a-9f9a-4db3-8050-a63341d55457'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:01.765250 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647ea31792be49c7a4fb69bf20652362', 'request_id': 'req-f461da3a-9f9a-4db3-8050-a63341d55457'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:01.777812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] The token cache is being invalidate because project 647ea31792be49c7a4fb69bf20652362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:24:01.778096 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:01.780689 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:01.782931 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1361/2751] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:24:01 2022] DELETE /identity/v3/projects/647ea31792be49c7a4fb69bf20652362 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:01.786985 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8baf38-5b2d-433d-9237-62914bdd54ac service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:01.797706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8baf38-5b2d-433d-9237-62914bdd54ac service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:01.877077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:01.878498 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:01.879539 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:01.879706 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] PATH_INFO: `/v3/users/3f0bf5f2ee0c4f93ba779b2b9a001241` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:01.880856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0bf5f2ee0c4f93ba779b2b9a001241)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:01.911285 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:02.165605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0bf5f2ee0c4f93ba779b2b9a001241'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:02.166237 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0bf5f2ee0c4f93ba779b2b9a001241'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:02.175470 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0bf5f2ee0c4f93ba779b2b9a001241'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:02.190052 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0bf5f2ee0c4f93ba779b2b9a001241'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:02.323289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99e13882-00e2-4a1d-acac-b213a5a676dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0bf5f2ee0c4f93ba779b2b9a001241'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:02.330998 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1391/2752] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:24:01 2022] DELETE /identity/v3/users/3f0bf5f2ee0c4f93ba779b2b9a001241 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:02.904967 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:02.906317 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:02.918404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461da3a-9f9a-4db3-8050-a63341d55457 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:02.985517 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:02.986225 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:02.986508 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:02.986815 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] PATH_INFO: `/v3/projects/4ecb52f353084182b1324dc3352fdf84` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:02.987924 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ecb52f353084182b1324dc3352fdf84)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:03.014792 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:03.125622 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ecb52f353084182b1324dc3352fdf84', 'request_id': 'req-0b314afc-9396-46d0-a070-49c0869f0aef'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:03.174091 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ecb52f353084182b1324dc3352fdf84', 'request_id': 'req-0b314afc-9396-46d0-a070-49c0869f0aef'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:03.186772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ecb52f353084182b1324dc3352fdf84', 'request_id': 'req-0b314afc-9396-46d0-a070-49c0869f0aef'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:03.196531 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] The token cache is being invalidate because project 4ecb52f353084182b1324dc3352fdf84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:24:03.196810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:03.197406 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-0b314afc-9396-46d0-a070-49c0869f0aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:03.199400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1362/2753] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:24:02 2022] DELETE /identity/v3/projects/4ecb52f353084182b1324dc3352fdf84 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:03.205040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039ecd-bcde-4c41-bd8a-eea8e95ebb8b None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:03.205557 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039ecd-bcde-4c41-bd8a-eea8e95ebb8b None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:03.205667 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b039ecd-bcde-4c41-bd8a-eea8e95ebb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:03.228183 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-7b039ecd-bcde-4c41-bd8a-eea8e95ebb8b None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:03.229319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7b039ecd-bcde-4c41-bd8a-eea8e95ebb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:03.293636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1392/2754] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:03.301202 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181bb6-6f1e-4c7f-8f36-243bcb33c779 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:03.301491 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181bb6-6f1e-4c7f-8f36-243bcb33c779 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:03.301775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec181bb6-6f1e-4c7f-8f36-243bcb33c779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:03.323873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ec181bb6-6f1e-4c7f-8f36-243bcb33c779 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:03.325164 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ec181bb6-6f1e-4c7f-8f36-243bcb33c779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:03.332178 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1363/2755] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:03.336401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039ecd-bcde-4c41-bd8a-eea8e95ebb8b None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:03.345844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b039ecd-bcde-4c41-bd8a-eea8e95ebb8b None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:03.350057 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591143a-ecc1-49ff-9300-6e8673329de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:03.350641 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591143a-ecc1-49ff-9300-6e8673329de6 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:03.350930 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591143a-ecc1-49ff-9300-6e8673329de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:03.351215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591143a-ecc1-49ff-9300-6e8673329de6 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:03.351932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591143a-ecc1-49ff-9300-6e8673329de6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:24:03.352239 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591143a-ecc1-49ff-9300-6e8673329de6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:03.378939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591143a-ecc1-49ff-9300-6e8673329de6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:03.392829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1393/2756] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 18 13:24:03.397446 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec181bb6-6f1e-4c7f-8f36-243bcb33c779 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:03.407106 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec181bb6-6f1e-4c7f-8f36-243bcb33c779 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:03.411396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097ac19-a082-4291-9b6a-cdc7e13a0fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:03.411980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097ac19-a082-4291-9b6a-cdc7e13a0fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:03.412268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097ac19-a082-4291-9b6a-cdc7e13a0fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:03.412548 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097ac19-a082-4291-9b6a-cdc7e13a0fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:03.413177 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097ac19-a082-4291-9b6a-cdc7e13a0fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:03.440147 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097ac19-a082-4291-9b6a-cdc7e13a0fc5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:03.507254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1364/2757] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:24:03 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:24:03.513204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591143a-ecc1-49ff-9300-6e8673329de6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:03.532395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591143a-ecc1-49ff-9300-6e8673329de6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:03.603593 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1abaf1-b03a-4e67-9c66-5e3ecabb9139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:03.604103 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1abaf1-b03a-4e67-9c66-5e3ecabb9139 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:03.604395 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1abaf1-b03a-4e67-9c66-5e3ecabb9139 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:03.604716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1abaf1-b03a-4e67-9c66-5e3ecabb9139 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:03.605558 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1abaf1-b03a-4e67-9c66-5e3ecabb9139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:03.631179 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1abaf1-b03a-4e67-9c66-5e3ecabb9139 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:03.713128 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1394/2758] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:24:03 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:24:03.719191 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097ac19-a082-4291-9b6a-cdc7e13a0fc5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:03.732633 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097ac19-a082-4291-9b6a-cdc7e13a0fc5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:03.737568 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2eb5c-4b1c-41c4-bd9f-06aa025bf213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:03.738162 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2eb5c-4b1c-41c4-bd9f-06aa025bf213 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:03.738444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2eb5c-4b1c-41c4-bd9f-06aa025bf213 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:03.738728 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2eb5c-4b1c-41c4-bd9f-06aa025bf213 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:03.739456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2eb5c-4b1c-41c4-bd9f-06aa025bf213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:03.765158 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2eb5c-4b1c-41c4-bd9f-06aa025bf213 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:03.775774 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1365/2759] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:03.784450 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1abaf1-b03a-4e67-9c66-5e3ecabb9139 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:03.794919 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1abaf1-b03a-4e67-9c66-5e3ecabb9139 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:03.799130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823e06-2bb6-4c6b-8f19-e37ade462bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:03.799972 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823e06-2bb6-4c6b-8f19-e37ade462bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:03.800261 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823e06-2bb6-4c6b-8f19-e37ade462bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:03.800542 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823e06-2bb6-4c6b-8f19-e37ade462bd4 admin admin] PATH_INFO: `/v3/projects/7ada0b4247544988b28f4ca5d46531aa/users/8cf42272e2e34fe19bc9310f75bbd870/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:03.820314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823e06-2bb6-4c6b-8f19-e37ade462bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ada0b4247544988b28f4ca5d46531aa, user_id=8cf42272e2e34fe19bc9310f75bbd870, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:03.847757 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823e06-2bb6-4c6b-8f19-e37ade462bd4 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:03.912427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1395/2760] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:03 2022] PUT /identity/v3/projects/7ada0b4247544988b28f4ca5d46531aa/users/8cf42272e2e34fe19bc9310f75bbd870/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:03.922730 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b321f0-682f-410e-a8c6-26e96eac1791 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:03.923428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b321f0-682f-410e-a8c6-26e96eac1791 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:03.923428 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b321f0-682f-410e-a8c6-26e96eac1791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:03.960268 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-95b321f0-682f-410e-a8c6-26e96eac1791 None None] MFA Rules not processed for user `8cf42272e2e34fe19bc9310f75bbd870`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:03.961434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-95b321f0-682f-410e-a8c6-26e96eac1791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:04.032927 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1366/2761] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:03 2022] POST /identity/v3/auth/tokens => generated 3686 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:04.037410 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823e06-2bb6-4c6b-8f19-e37ade462bd4 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:04.129462 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823e06-2bb6-4c6b-8f19-e37ade462bd4 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:04.134008 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79435f86-a285-4bc8-b980-ebb2354dee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:04.134752 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79435f86-a285-4bc8-b980-ebb2354dee88 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:04.134915 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79435f86-a285-4bc8-b980-ebb2354dee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:04.135129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79435f86-a285-4bc8-b980-ebb2354dee88 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:04.135841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79435f86-a285-4bc8-b980-ebb2354dee88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:04.162793 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79435f86-a285-4bc8-b980-ebb2354dee88 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:04.238562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1396/2762] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:24:04 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:24:04.242917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b321f0-682f-410e-a8c6-26e96eac1791 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:04.253944 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b321f0-682f-410e-a8c6-26e96eac1791 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:04.318561 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93de99-2d1f-4290-9318-218a1ebfa0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:04.319197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93de99-2d1f-4290-9318-218a1ebfa0ce admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:04.319521 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93de99-2d1f-4290-9318-218a1ebfa0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:04.319809 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93de99-2d1f-4290-9318-218a1ebfa0ce admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:04.320451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93de99-2d1f-4290-9318-218a1ebfa0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:04.347589 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93de99-2d1f-4290-9318-218a1ebfa0ce admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:04.421174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1367/2763] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:24:04 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:24:04.425090 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79435f86-a285-4bc8-b980-ebb2354dee88 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:04.435644 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79435f86-a285-4bc8-b980-ebb2354dee88 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:04.439856 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabc26b-f8f7-4025-b78c-ac6b8248364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:04.440438 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc26b-f8f7-4025-b78c-ac6b8248364c admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:04.440728 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc26b-f8f7-4025-b78c-ac6b8248364c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:04.441012 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabc26b-f8f7-4025-b78c-ac6b8248364c admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:04.441699 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabc26b-f8f7-4025-b78c-ac6b8248364c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:04.468501 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabc26b-f8f7-4025-b78c-ac6b8248364c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:04.480865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1397/2764] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:04.485092 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93de99-2d1f-4290-9318-218a1ebfa0ce admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:04.495526 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93de99-2d1f-4290-9318-218a1ebfa0ce admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:04.499936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d043b4-bf5b-4e1a-953d-01fcd12249a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:04.500811 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d043b4-bf5b-4e1a-953d-01fcd12249a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:04.501073 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d043b4-bf5b-4e1a-953d-01fcd12249a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:04.501352 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d043b4-bf5b-4e1a-953d-01fcd12249a5 admin admin] PATH_INFO: `/v3/projects/aa47bbd409b84385ba9769ced5374b25/users/14a2a28d1d294f15a3dcc034f98bada5/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:04.522150 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d043b4-bf5b-4e1a-953d-01fcd12249a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa47bbd409b84385ba9769ced5374b25, user_id=14a2a28d1d294f15a3dcc034f98bada5, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:04.550239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d043b4-bf5b-4e1a-953d-01fcd12249a5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:04.655418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1368/2765] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:04 2022] PUT /identity/v3/projects/aa47bbd409b84385ba9769ced5374b25/users/14a2a28d1d294f15a3dcc034f98bada5/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:04.659598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabc26b-f8f7-4025-b78c-ac6b8248364c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:04.669805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabc26b-f8f7-4025-b78c-ac6b8248364c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:04.735585 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be786446-b502-42e9-9b9e-96424496e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:04.736097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786446-b502-42e9-9b9e-96424496e172 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:04.736389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786446-b502-42e9-9b9e-96424496e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:04.736673 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be786446-b502-42e9-9b9e-96424496e172 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:04.737359 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be786446-b502-42e9-9b9e-96424496e172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:04.764769 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be786446-b502-42e9-9b9e-96424496e172 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:04.775417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1398/2766] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 18 13:24:04.784466 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d043b4-bf5b-4e1a-953d-01fcd12249a5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:04.794532 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d043b4-bf5b-4e1a-953d-01fcd12249a5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:04.798804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d827e-2696-47b8-8d0d-1dce5dd4c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:04.799654 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d827e-2696-47b8-8d0d-1dce5dd4c35d admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:04.799943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d827e-2696-47b8-8d0d-1dce5dd4c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:04.800223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d827e-2696-47b8-8d0d-1dce5dd4c35d admin admin] PATH_INFO: `/v3/projects/aa47bbd409b84385ba9769ced5374b25/users/14a2a28d1d294f15a3dcc034f98bada5/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:04.802049 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d827e-2696-47b8-8d0d-1dce5dd4c35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa47bbd409b84385ba9769ced5374b25, user_id=14a2a28d1d294f15a3dcc034f98bada5, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:04.829445 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d827e-2696-47b8-8d0d-1dce5dd4c35d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:04.840980 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1369/2767] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:04 2022] PUT /identity/v3/projects/aa47bbd409b84385ba9769ced5374b25/users/14a2a28d1d294f15a3dcc034f98bada5/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:04.845040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be786446-b502-42e9-9b9e-96424496e172 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:04.854816 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be786446-b502-42e9-9b9e-96424496e172 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:04.920880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba08c1-944d-4fc2-908f-bc72d5730e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:04.921475 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba08c1-944d-4fc2-908f-bc72d5730e17 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:04.921767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba08c1-944d-4fc2-908f-bc72d5730e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:04.922045 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba08c1-944d-4fc2-908f-bc72d5730e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:04.922776 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba08c1-944d-4fc2-908f-bc72d5730e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:04.950121 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba08c1-944d-4fc2-908f-bc72d5730e17 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:04.961130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1399/2768] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:04.965475 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d827e-2696-47b8-8d0d-1dce5dd4c35d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:04.975671 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d827e-2696-47b8-8d0d-1dce5dd4c35d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:04.980118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfb017-1a86-4bfb-adf9-50f257da844b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:04.981017 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfb017-1a86-4bfb-adf9-50f257da844b admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:04.981297 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfb017-1a86-4bfb-adf9-50f257da844b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:04.981574 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfb017-1a86-4bfb-adf9-50f257da844b admin admin] PATH_INFO: `/v3/projects/aa47bbd409b84385ba9769ced5374b25/users/14a2a28d1d294f15a3dcc034f98bada5/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:04.983364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfb017-1a86-4bfb-adf9-50f257da844b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa47bbd409b84385ba9769ced5374b25, user_id=14a2a28d1d294f15a3dcc034f98bada5, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:05.014353 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfb017-1a86-4bfb-adf9-50f257da844b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:05.108495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1370/2769] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:04 2022] PUT /identity/v3/projects/aa47bbd409b84385ba9769ced5374b25/users/14a2a28d1d294f15a3dcc034f98bada5/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:24:05.120196 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986dfaa-6f57-4a5e-855d-8e61e8ddd792 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:05.121165 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986dfaa-6f57-4a5e-855d-8e61e8ddd792 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:05.121514 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986dfaa-6f57-4a5e-855d-8e61e8ddd792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:05.158050 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-a986dfaa-6f57-4a5e-855d-8e61e8ddd792 None None] MFA Rules not processed for user `14a2a28d1d294f15a3dcc034f98bada5`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:05.159195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-a986dfaa-6f57-4a5e-855d-8e61e8ddd792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:05.317118 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1400/2770] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:05 2022] POST /identity/v3/auth/tokens => generated 3755 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:05.326964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfb017-1a86-4bfb-adf9-50f257da844b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:05.328569 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1cdfb017-1a86-4bfb-adf9-50f257da844b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:05.475882 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfb017-1a86-4bfb-adf9-50f257da844b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:05.479299 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede95418-f42b-4f9b-8278-2aff30619685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:05.479963 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede95418-f42b-4f9b-8278-2aff30619685 service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:05.480246 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede95418-f42b-4f9b-8278-2aff30619685 service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:05.480549 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede95418-f42b-4f9b-8278-2aff30619685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:05.489306 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede95418-f42b-4f9b-8278-2aff30619685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:05.515289 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede95418-f42b-4f9b-8278-2aff30619685 service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:05.524668 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1371/2771] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:05 2022] GET /identity/v3/auth/tokens => generated 3755 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:06.296897 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986dfaa-6f57-4a5e-855d-8e61e8ddd792 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:06.366319 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986dfaa-6f57-4a5e-855d-8e61e8ddd792 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:06.371068 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:06.374725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:06.374725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:06.374725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] PATH_INFO: `/v3/users/8cf42272e2e34fe19bc9310f75bbd870` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:06.374725 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf42272e2e34fe19bc9310f75bbd870)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:06.400889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:06.634399 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf42272e2e34fe19bc9310f75bbd870'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:06.635059 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf42272e2e34fe19bc9310f75bbd870'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:06.644070 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf42272e2e34fe19bc9310f75bbd870'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:06.656281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf42272e2e34fe19bc9310f75bbd870'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:06.717213 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf42272e2e34fe19bc9310f75bbd870'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:06.723778 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1401/2772] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:24:06 2022] DELETE /identity/v3/users/8cf42272e2e34fe19bc9310f75bbd870 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:06.728361 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005ae7b-c845-46d2-b52e-43e54f80a393 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:06.728861 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005ae7b-c845-46d2-b52e-43e54f80a393 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:06.728962 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005ae7b-c845-46d2-b52e-43e54f80a393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:06.751629 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-a005ae7b-c845-46d2-b52e-43e54f80a393 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:06.752772 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a005ae7b-c845-46d2-b52e-43e54f80a393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:06.820444 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1372/2773] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:06 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:06.831124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:06.832502 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:06.896962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a40da4-9d30-4e06-8c2d-97dbe91575c9 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:06.900367 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7450b0-9490-42cd-8499-a0f625741ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:06.900944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7450b0-9490-42cd-8499-a0f625741ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:06.901233 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7450b0-9490-42cd-8499-a0f625741ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:06.902447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7450b0-9490-42cd-8499-a0f625741ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:06.911487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7450b0-9490-42cd-8499-a0f625741ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:06.936788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7450b0-9490-42cd-8499-a0f625741ca8 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:06.946224 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1402/2774] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:06 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:07.614365 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005ae7b-c845-46d2-b52e-43e54f80a393 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:07.615742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-a005ae7b-c845-46d2-b52e-43e54f80a393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:07.629192 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005ae7b-c845-46d2-b52e-43e54f80a393 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:07.633663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:07.634450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:07.634739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:07.635021 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] PATH_INFO: `/v3/projects/7ada0b4247544988b28f4ca5d46531aa` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:07.636781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ada0b4247544988b28f4ca5d46531aa)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:07.663010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:07.823109 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ada0b4247544988b28f4ca5d46531aa', 'request_id': 'req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:07.935300 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ada0b4247544988b28f4ca5d46531aa', 'request_id': 'req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:07.946745 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ada0b4247544988b28f4ca5d46531aa', 'request_id': 'req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:07.957054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] The token cache is being invalidate because project 7ada0b4247544988b28f4ca5d46531aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:24:07.957329 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:07.957936 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:07.959414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1373/2775] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:24:07 2022] DELETE /identity/v3/projects/7ada0b4247544988b28f4ca5d46531aa => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:07.963364 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7450b0-9490-42cd-8499-a0f625741ca8 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:07.973130 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7450b0-9490-42cd-8499-a0f625741ca8 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:08.036529 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:08.037314 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:08.037598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:08.037872 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] PATH_INFO: `/v3/users/14a2a28d1d294f15a3dcc034f98bada5` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:08.038939 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a2a28d1d294f15a3dcc034f98bada5)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:08.065187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:08.262040 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a2a28d1d294f15a3dcc034f98bada5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:08.266759 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a2a28d1d294f15a3dcc034f98bada5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:08.270997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a2a28d1d294f15a3dcc034f98bada5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:08.283112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a2a28d1d294f15a3dcc034f98bada5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:08.380391 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-99a8167a-7b3e-4c57-97e7-4b6c624bf7d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a2a28d1d294f15a3dcc034f98bada5'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:08.387845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1403/2776] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:24:07 2022] DELETE /identity/v3/users/14a2a28d1d294f15a3dcc034f98bada5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:08.989062 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:08.990472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:09.004043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76c9c9-c623-45c5-ace5-bafe34b5ba1b admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:09.070301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:09.071050 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:09.071350 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:09.071627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] PATH_INFO: `/v3/projects/aa47bbd409b84385ba9769ced5374b25` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:09.072760 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa47bbd409b84385ba9769ced5374b25)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:09.098649 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:09.228501 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa47bbd409b84385ba9769ced5374b25', 'request_id': 'req-28fefc44-964c-426c-b1d1-b4e2178981d8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:09.300207 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa47bbd409b84385ba9769ced5374b25', 'request_id': 'req-28fefc44-964c-426c-b1d1-b4e2178981d8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:09.312945 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa47bbd409b84385ba9769ced5374b25', 'request_id': 'req-28fefc44-964c-426c-b1d1-b4e2178981d8'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:09.323368 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] The token cache is being invalidate because project aa47bbd409b84385ba9769ced5374b25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:24:09.323597 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:09.324301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-28fefc44-964c-426c-b1d1-b4e2178981d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:09.325723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1374/2777] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:24:08 2022] DELETE /identity/v3/projects/aa47bbd409b84385ba9769ced5374b25 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:09.331721 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aa78f-fd09-4835-8359-30a9554de9a3 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:09.332245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aa78f-fd09-4835-8359-30a9554de9a3 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:09.332358 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aa78f-fd09-4835-8359-30a9554de9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:09.358141 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-c60aa78f-fd09-4835-8359-30a9554de9a3 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:09.359292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-c60aa78f-fd09-4835-8359-30a9554de9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:09.425672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1404/2778] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:09.434165 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ba50-fdb7-4823-907a-fb7b5e4536f8 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:09.434450 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ba50-fdb7-4823-907a-fb7b5e4536f8 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:09.434777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30ba50-fdb7-4823-907a-fb7b5e4536f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:09.457641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-6f30ba50-fdb7-4823-907a-fb7b5e4536f8 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:09.458852 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-6f30ba50-fdb7-4823-907a-fb7b5e4536f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:09.466640 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1375/2779] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:09 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:09.470968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aa78f-fd09-4835-8359-30a9554de9a3 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:09.480902 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aa78f-fd09-4835-8359-30a9554de9a3 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:09.485198 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138441b-eff0-4ba0-8e90-c2c9ec582192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:09.485788 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138441b-eff0-4ba0-8e90-c2c9ec582192 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:09.486080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138441b-eff0-4ba0-8e90-c2c9ec582192 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:09.486394 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138441b-eff0-4ba0-8e90-c2c9ec582192 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:09.487079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138441b-eff0-4ba0-8e90-c2c9ec582192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:24:09.487455 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138441b-eff0-4ba0-8e90-c2c9ec582192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:09.513360 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138441b-eff0-4ba0-8e90-c2c9ec582192 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:09.528741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1405/2780] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:24:09.533195 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30ba50-fdb7-4823-907a-fb7b5e4536f8 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:09.542236 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f30ba50-fdb7-4823-907a-fb7b5e4536f8 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:09.547420 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1937c1-2d72-4768-a985-16c43b918ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:09.548001 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1937c1-2d72-4768-a985-16c43b918ccf admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:09.548286 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1937c1-2d72-4768-a985-16c43b918ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:09.548562 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1937c1-2d72-4768-a985-16c43b918ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:09.549194 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1937c1-2d72-4768-a985-16c43b918ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:09.585160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1937c1-2d72-4768-a985-16c43b918ccf admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:09.685087 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1376/2781] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:24:09 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:24:09.689390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138441b-eff0-4ba0-8e90-c2c9ec582192 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:09.699043 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138441b-eff0-4ba0-8e90-c2c9ec582192 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:09.764393 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00187e5-44f8-4eeb-ab6e-4dae4adff608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:09.764993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00187e5-44f8-4eeb-ab6e-4dae4adff608 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:09.765364 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00187e5-44f8-4eeb-ab6e-4dae4adff608 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:09.765646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00187e5-44f8-4eeb-ab6e-4dae4adff608 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:09.766278 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00187e5-44f8-4eeb-ab6e-4dae4adff608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:09.791831 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00187e5-44f8-4eeb-ab6e-4dae4adff608 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:09.900503 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1406/2782] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:24:09 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:24:09.904699 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1937c1-2d72-4768-a985-16c43b918ccf admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:09.915008 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1937c1-2d72-4768-a985-16c43b918ccf admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:09.920130 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7cee05-56df-4c0b-b1ef-14b83017de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:09.920726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cee05-56df-4c0b-b1ef-14b83017de68 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:09.921014 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cee05-56df-4c0b-b1ef-14b83017de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:09.921394 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7cee05-56df-4c0b-b1ef-14b83017de68 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:09.922095 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cee05-56df-4c0b-b1ef-14b83017de68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:09.948210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7cee05-56df-4c0b-b1ef-14b83017de68 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:09.958917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1377/2783] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:09.963226 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00187e5-44f8-4eeb-ab6e-4dae4adff608 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:09.973236 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00187e5-44f8-4eeb-ab6e-4dae4adff608 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:09.977528 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5e62e-0777-4485-9934-12fd887cb2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:09.980567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5e62e-0777-4485-9934-12fd887cb2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:09.980567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5e62e-0777-4485-9934-12fd887cb2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:09.980567 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5e62e-0777-4485-9934-12fd887cb2bc admin admin] PATH_INFO: `/v3/projects/d5e7a5339eef4737823bee61c5d5cd4a/users/849cd3a9270349b99e2a4f2573879784/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:10.000376 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5e62e-0777-4485-9934-12fd887cb2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5e7a5339eef4737823bee61c5d5cd4a, user_id=849cd3a9270349b99e2a4f2573879784, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:10.026568 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5e62e-0777-4485-9934-12fd887cb2bc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:10.100289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1407/2784] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:09 2022] PUT /identity/v3/projects/d5e7a5339eef4737823bee61c5d5cd4a/users/849cd3a9270349b99e2a4f2573879784/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:10.112120 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae01c4-0e0b-4d1d-befc-1d356e2b14c3 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:10.112678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae01c4-0e0b-4d1d-befc-1d356e2b14c3 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:10.112678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae01c4-0e0b-4d1d-befc-1d356e2b14c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:10.152476 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-e9ae01c4-0e0b-4d1d-befc-1d356e2b14c3 None None] MFA Rules not processed for user `849cd3a9270349b99e2a4f2573879784`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:10.154636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e9ae01c4-0e0b-4d1d-befc-1d356e2b14c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:10.226204 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1378/2785] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:10 2022] POST /identity/v3/auth/tokens => generated 3690 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:10.231132 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5e62e-0777-4485-9934-12fd887cb2bc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:10.299265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5e62e-0777-4485-9934-12fd887cb2bc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:10.303555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4be47a-20e2-45b1-9154-a8290c977de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:10.304131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4be47a-20e2-45b1-9154-a8290c977de3 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:10.304416 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4be47a-20e2-45b1-9154-a8290c977de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:10.304695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4be47a-20e2-45b1-9154-a8290c977de3 admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:10.305329 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4be47a-20e2-45b1-9154-a8290c977de3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:10.331194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4be47a-20e2-45b1-9154-a8290c977de3 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:10.455916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1408/2786] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:24:10 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:24:10.460055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae01c4-0e0b-4d1d-befc-1d356e2b14c3 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:10.471071 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae01c4-0e0b-4d1d-befc-1d356e2b14c3 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:10.534705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a5461-e1eb-4444-bb7c-3f67f4371638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:10.535342 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a5461-e1eb-4444-bb7c-3f67f4371638 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:10.535638 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a5461-e1eb-4444-bb7c-3f67f4371638 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:10.535922 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a5461-e1eb-4444-bb7c-3f67f4371638 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:10.536572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a5461-e1eb-4444-bb7c-3f67f4371638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:10.564761 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a5461-e1eb-4444-bb7c-3f67f4371638 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:10.644461 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1379/2787] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:24:10 2022] POST /identity/v3/users => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 18 13:24:10.648467 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4be47a-20e2-45b1-9154-a8290c977de3 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:10.659078 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4be47a-20e2-45b1-9154-a8290c977de3 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:10.663419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150ed1-4d06-4213-a2cd-94e2bc029757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:10.665561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150ed1-4d06-4213-a2cd-94e2bc029757 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:10.665561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150ed1-4d06-4213-a2cd-94e2bc029757 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:10.665561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150ed1-4d06-4213-a2cd-94e2bc029757 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:10.665561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37150ed1-4d06-4213-a2cd-94e2bc029757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:10.690916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37150ed1-4d06-4213-a2cd-94e2bc029757 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:10.703613 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1409/2788] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:10.707848 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a5461-e1eb-4444-bb7c-3f67f4371638 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:10.718442 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a5461-e1eb-4444-bb7c-3f67f4371638 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:10.722658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f855b27-0f5e-4d13-89fb-3e1df12857d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:10.723570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f855b27-0f5e-4d13-89fb-3e1df12857d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:10.723856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f855b27-0f5e-4d13-89fb-3e1df12857d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:10.724154 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f855b27-0f5e-4d13-89fb-3e1df12857d1 admin admin] PATH_INFO: `/v3/projects/53abd8883f124619a1296c0f8d6c7b05/users/17b68f2d53974c7487491e2d02fe7cc7/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:10.744515 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f855b27-0f5e-4d13-89fb-3e1df12857d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53abd8883f124619a1296c0f8d6c7b05, user_id=17b68f2d53974c7487491e2d02fe7cc7, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:10.772341 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f855b27-0f5e-4d13-89fb-3e1df12857d1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:10.872951 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1380/2789] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:10 2022] PUT /identity/v3/projects/53abd8883f124619a1296c0f8d6c7b05/users/17b68f2d53974c7487491e2d02fe7cc7/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:10.877077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150ed1-4d06-4213-a2cd-94e2bc029757 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:10.886907 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150ed1-4d06-4213-a2cd-94e2bc029757 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:10.951513 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11ebd8-d3ca-4286-96aa-1ae33a98f176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:10.952102 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11ebd8-d3ca-4286-96aa-1ae33a98f176 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:10.952388 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11ebd8-d3ca-4286-96aa-1ae33a98f176 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:10.952668 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11ebd8-d3ca-4286-96aa-1ae33a98f176 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:10.953346 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11ebd8-d3ca-4286-96aa-1ae33a98f176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:10.978592 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11ebd8-d3ca-4286-96aa-1ae33a98f176 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:10.989047 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1410/2790] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:10.993398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f855b27-0f5e-4d13-89fb-3e1df12857d1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:11.004210 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f855b27-0f5e-4d13-89fb-3e1df12857d1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:11.008464 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f2a4d-2378-4047-aa9c-e174644a1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:11.009313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f2a4d-2378-4047-aa9c-e174644a1611 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:11.009592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f2a4d-2378-4047-aa9c-e174644a1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:11.009874 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f2a4d-2378-4047-aa9c-e174644a1611 admin admin] PATH_INFO: `/v3/projects/53abd8883f124619a1296c0f8d6c7b05/users/17b68f2d53974c7487491e2d02fe7cc7/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:11.011686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f2a4d-2378-4047-aa9c-e174644a1611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53abd8883f124619a1296c0f8d6c7b05, user_id=17b68f2d53974c7487491e2d02fe7cc7, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:11.038868 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f2a4d-2378-4047-aa9c-e174644a1611 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:11.049528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1381/2791] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:10 2022] PUT /identity/v3/projects/53abd8883f124619a1296c0f8d6c7b05/users/17b68f2d53974c7487491e2d02fe7cc7/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:11.053386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11ebd8-d3ca-4286-96aa-1ae33a98f176 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:11.063948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11ebd8-d3ca-4286-96aa-1ae33a98f176 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:11.130437 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea8f873-2d0a-456c-a6f8-032b6e71ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:11.131054 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8f873-2d0a-456c-a6f8-032b6e71ab79 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:11.131370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8f873-2d0a-456c-a6f8-032b6e71ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:11.131662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea8f873-2d0a-456c-a6f8-032b6e71ab79 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:11.132363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8f873-2d0a-456c-a6f8-032b6e71ab79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:11.162281 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea8f873-2d0a-456c-a6f8-032b6e71ab79 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:11.174348 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1411/2792] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:11.178431 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f2a4d-2378-4047-aa9c-e174644a1611 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:11.189451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f2a4d-2378-4047-aa9c-e174644a1611 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:11.193836 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566753-5995-41ea-a1e1-8b891667f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:11.194647 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566753-5995-41ea-a1e1-8b891667f376 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:11.194942 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566753-5995-41ea-a1e1-8b891667f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:11.195223 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80566753-5995-41ea-a1e1-8b891667f376 admin admin] PATH_INFO: `/v3/projects/53abd8883f124619a1296c0f8d6c7b05/users/17b68f2d53974c7487491e2d02fe7cc7/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:11.197075 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80566753-5995-41ea-a1e1-8b891667f376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53abd8883f124619a1296c0f8d6c7b05, user_id=17b68f2d53974c7487491e2d02fe7cc7, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:11.225010 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80566753-5995-41ea-a1e1-8b891667f376 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:11.302054 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1382/2793] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:11 2022] PUT /identity/v3/projects/53abd8883f124619a1296c0f8d6c7b05/users/17b68f2d53974c7487491e2d02fe7cc7/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:11.313009 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee395-3d5f-4242-b0eb-181913344b52 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:11.320522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee395-3d5f-4242-b0eb-181913344b52 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:11.320522 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cee395-3d5f-4242-b0eb-181913344b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:11.351294 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-59cee395-3d5f-4242-b0eb-181913344b52 None None] MFA Rules not processed for user `17b68f2d53974c7487491e2d02fe7cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:11.352487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-59cee395-3d5f-4242-b0eb-181913344b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:11.428906 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1412/2794] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:11 2022] POST /identity/v3/auth/tokens => generated 3757 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:11.439954 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566753-5995-41ea-a1e1-8b891667f376 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:11.441569 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-80566753-5995-41ea-a1e1-8b891667f376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:11.512288 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80566753-5995-41ea-a1e1-8b891667f376 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:11.516504 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f303335-0317-4817-adf0-de3b326de33d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:11.517174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303335-0317-4817-adf0-de3b326de33d service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:11.517570 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303335-0317-4817-adf0-de3b326de33d service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:11.517993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f303335-0317-4817-adf0-de3b326de33d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:11.528152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f303335-0317-4817-adf0-de3b326de33d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:11.554249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f303335-0317-4817-adf0-de3b326de33d service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:11.565315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1383/2795] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:11 2022] GET /identity/v3/auth/tokens => generated 3757 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:11.720786 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cee395-3d5f-4242-b0eb-181913344b52 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:11.730403 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cee395-3d5f-4242-b0eb-181913344b52 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:11.734646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c410a78-1e9e-41ef-8749-2c22964c3cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:11.735245 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410a78-1e9e-41ef-8749-2c22964c3cbe service cinder] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:11.735565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410a78-1e9e-41ef-8749-2c22964c3cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:11.735849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c410a78-1e9e-41ef-8749-2c22964c3cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:11.799370 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c410a78-1e9e-41ef-8749-2c22964c3cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:11.826415 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c410a78-1e9e-41ef-8749-2c22964c3cbe service cinder] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:11.835912 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1413/2796] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:11 2022] GET /identity/v3/auth/tokens => generated 3690 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:12.461128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f303335-0317-4817-adf0-de3b326de33d service cinder] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:12.531364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f303335-0317-4817-adf0-de3b326de33d service cinder] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:12.535972 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:12.538364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:12.538364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:12.538364 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] PATH_INFO: `/v3/users/849cd3a9270349b99e2a4f2573879784` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:12.538690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=849cd3a9270349b99e2a4f2573879784)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:12.565264 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:12.772085 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849cd3a9270349b99e2a4f2573879784'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:12.784798 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849cd3a9270349b99e2a4f2573879784'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:12.785448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849cd3a9270349b99e2a4f2573879784'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:12.792991 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849cd3a9270349b99e2a4f2573879784'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:12.865845 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849cd3a9270349b99e2a4f2573879784'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:12.872233 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1384/2797] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:24:12 2022] DELETE /identity/v3/users/849cd3a9270349b99e2a4f2573879784 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:12.877194 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b96c3-9f11-47a2-85ce-f0b38024c25d None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:12.877737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b96c3-9f11-47a2-85ce-f0b38024c25d None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:12.877737 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b96c3-9f11-47a2-85ce-f0b38024c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:12.900695 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-e09b96c3-9f11-47a2-85ce-f0b38024c25d None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:12.901827 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e09b96c3-9f11-47a2-85ce-f0b38024c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:12.966685 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1414/2798] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:12 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:12.976917 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:12.978292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:13.046656 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0128ec-a62d-40d0-a5c7-996ab623de7d admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:13.050015 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0492a50-93b8-48f3-84f8-17069dcec99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:13.050607 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0492a50-93b8-48f3-84f8-17069dcec99f service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:13.050891 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0492a50-93b8-48f3-84f8-17069dcec99f service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:13.051171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0492a50-93b8-48f3-84f8-17069dcec99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:13.061880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0492a50-93b8-48f3-84f8-17069dcec99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:13.087398 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0492a50-93b8-48f3-84f8-17069dcec99f service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:13.098215 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1385/2799] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:12 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:13.566336 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b96c3-9f11-47a2-85ce-f0b38024c25d None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:13.567782 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-e09b96c3-9f11-47a2-85ce-f0b38024c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:13.580945 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b96c3-9f11-47a2-85ce-f0b38024c25d None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:13.584435 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:13.585248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:13.585555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:13.585813 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] PATH_INFO: `/v3/projects/d5e7a5339eef4737823bee61c5d5cd4a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:13.586880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5e7a5339eef4737823bee61c5d5cd4a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:13.614418 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:13.742074 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5e7a5339eef4737823bee61c5d5cd4a', 'request_id': 'req-7360e59e-d2a9-487c-8efb-4fedf1e9007e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:13.831993 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5e7a5339eef4737823bee61c5d5cd4a', 'request_id': 'req-7360e59e-d2a9-487c-8efb-4fedf1e9007e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:13.844532 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5e7a5339eef4737823bee61c5d5cd4a', 'request_id': 'req-7360e59e-d2a9-487c-8efb-4fedf1e9007e'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:13.854665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] The token cache is being invalidate because project d5e7a5339eef4737823bee61c5d5cd4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:24:13.854948 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:13.855845 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:13.857187 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1415/2800] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:24:13 2022] DELETE /identity/v3/projects/d5e7a5339eef4737823bee61c5d5cd4a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:13.862899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0492a50-93b8-48f3-84f8-17069dcec99f service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:13.875851 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0492a50-93b8-48f3-84f8-17069dcec99f service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:13.940627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:13.941424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:13.941712 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:13.941997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] PATH_INFO: `/v3/users/17b68f2d53974c7487491e2d02fe7cc7` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:13.943093 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b68f2d53974c7487491e2d02fe7cc7)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:13.969189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:14.119800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b68f2d53974c7487491e2d02fe7cc7'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.132677 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b68f2d53974c7487491e2d02fe7cc7'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.133363 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b68f2d53974c7487491e2d02fe7cc7'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.142239 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b68f2d53974c7487491e2d02fe7cc7'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.191480 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-90e48462-4003-4954-9ec3-b27961c59fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b68f2d53974c7487491e2d02fe7cc7'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.197748 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1386/2801] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:24:13 2022] DELETE /identity/v3/users/17b68f2d53974c7487491e2d02fe7cc7 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:14.663351 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:14.664821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:14.678063 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360e59e-d2a9-487c-8efb-4fedf1e9007e admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:14.740654 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:14.741443 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:14.741731 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:14.742013 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] PATH_INFO: `/v3/projects/53abd8883f124619a1296c0f8d6c7b05` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:14.743093 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=53abd8883f124619a1296c0f8d6c7b05)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:14.769030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:14.918982 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53abd8883f124619a1296c0f8d6c7b05', 'request_id': 'req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.968717 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53abd8883f124619a1296c0f8d6c7b05', 'request_id': 'req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.981184 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53abd8883f124619a1296c0f8d6c7b05', 'request_id': 'req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.992206 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] The token cache is being invalidate because project 53abd8883f124619a1296c0f8d6c7b05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:24:14.992488 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.993113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-3e3267c1-8ab1-48d3-b05a-8e32b6b9e4cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:14.994555 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1416/2802] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:24:14 2022] DELETE /identity/v3/projects/53abd8883f124619a1296c0f8d6c7b05 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:15.000421 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29d6cc-8ace-4bdb-9ee5-8206e7c77740 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:15.000897 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29d6cc-8ace-4bdb-9ee5-8206e7c77740 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:15.000995 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29d6cc-8ace-4bdb-9ee5-8206e7c77740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:15.024282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-cb29d6cc-8ace-4bdb-9ee5-8206e7c77740 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:15.025441 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-cb29d6cc-8ace-4bdb-9ee5-8206e7c77740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:15.094692 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1387/2803] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:14 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:15.108340 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed9b1-4735-4718-8a7b-9143e6a89f16 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:15.108749 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed9b1-4735-4718-8a7b-9143e6a89f16 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:15.109131 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ed9b1-4735-4718-8a7b-9143e6a89f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:15.132580 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d11ed9b1-4735-4718-8a7b-9143e6a89f16 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:15.133765 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d11ed9b1-4735-4718-8a7b-9143e6a89f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:15.142195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1417/2804] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:15 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:15.146443 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29d6cc-8ace-4bdb-9ee5-8206e7c77740 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:15.160282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb29d6cc-8ace-4bdb-9ee5-8206e7c77740 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:15.164628 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b072b9-ff06-401d-8d3a-e52ff6a7a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:15.165222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b072b9-ff06-401d-8d3a-e52ff6a7a4eb admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:15.165511 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b072b9-ff06-401d-8d3a-e52ff6a7a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:15.165865 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b072b9-ff06-401d-8d3a-e52ff6a7a4eb admin admin] PATH_INFO: `/v3/domains` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:15.166690 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b072b9-ff06-401d-8d3a-e52ff6a7a4eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66304) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:24:15.167004 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b072b9-ff06-401d-8d3a-e52ff6a7a4eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:15.195610 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b072b9-ff06-401d-8d3a-e52ff6a7a4eb admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:15.210276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1388/2805] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:24:15.214646 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ed9b1-4735-4718-8a7b-9143e6a89f16 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:15.224219 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ed9b1-4735-4718-8a7b-9143e6a89f16 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:15.228466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a695-464e-4cbc-8c46-40b483709b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:15.229041 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a695-464e-4cbc-8c46-40b483709b2f admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:15.229324 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a695-464e-4cbc-8c46-40b483709b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:15.229598 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172a695-464e-4cbc-8c46-40b483709b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:15.230229 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172a695-464e-4cbc-8c46-40b483709b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:15.255854 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172a695-464e-4cbc-8c46-40b483709b2f admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:15.340828 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1418/2806] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:24:15 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:24:15.346197 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b072b9-ff06-401d-8d3a-e52ff6a7a4eb admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:15.355489 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b072b9-ff06-401d-8d3a-e52ff6a7a4eb admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:15.418658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f958e24-20e5-430c-8624-d13a5b4bce06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:15.419254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f958e24-20e5-430c-8624-d13a5b4bce06 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:15.419577 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f958e24-20e5-430c-8624-d13a5b4bce06 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:15.419890 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f958e24-20e5-430c-8624-d13a5b4bce06 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:15.420622 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f958e24-20e5-430c-8624-d13a5b4bce06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:15.446829 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f958e24-20e5-430c-8624-d13a5b4bce06 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:15.563820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1389/2807] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:24:15 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:24:15.568021 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a695-464e-4cbc-8c46-40b483709b2f admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:15.578711 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172a695-464e-4cbc-8c46-40b483709b2f admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:15.582766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be3da1-1f62-41f2-8524-89da2b2d9873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:15.583381 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be3da1-1f62-41f2-8524-89da2b2d9873 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:15.583821 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be3da1-1f62-41f2-8524-89da2b2d9873 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:15.584107 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be3da1-1f62-41f2-8524-89da2b2d9873 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:15.584830 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be3da1-1f62-41f2-8524-89da2b2d9873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:15.616710 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be3da1-1f62-41f2-8524-89da2b2d9873 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:15.628799 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1419/2808] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:15.633105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f958e24-20e5-430c-8624-d13a5b4bce06 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:15.643274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f958e24-20e5-430c-8624-d13a5b4bce06 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:15.647414 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36619ba-a8cf-4487-ba5b-039748d67554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:15.648224 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36619ba-a8cf-4487-ba5b-039748d67554 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:15.648505 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36619ba-a8cf-4487-ba5b-039748d67554 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:15.648778 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36619ba-a8cf-4487-ba5b-039748d67554 admin admin] PATH_INFO: `/v3/projects/a0eb0c29a9e74200a741d06253505c21/users/3b911d9a0160463ab15af8830f2cb27c/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:15.670839 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36619ba-a8cf-4487-ba5b-039748d67554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0eb0c29a9e74200a741d06253505c21, user_id=3b911d9a0160463ab15af8830f2cb27c, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:15.697221 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36619ba-a8cf-4487-ba5b-039748d67554 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:15.769735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1390/2809] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:15 2022] PUT /identity/v3/projects/a0eb0c29a9e74200a741d06253505c21/users/3b911d9a0160463ab15af8830f2cb27c/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:15.781523 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349511ef-6a16-47c1-a49e-5f450d396496 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:15.782034 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349511ef-6a16-47c1-a49e-5f450d396496 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:15.782176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349511ef-6a16-47c1-a49e-5f450d396496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:15.818271 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-349511ef-6a16-47c1-a49e-5f450d396496 None None] MFA Rules not processed for user `3b911d9a0160463ab15af8830f2cb27c`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:15.819506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-349511ef-6a16-47c1-a49e-5f450d396496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:15.893511 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1420/2810] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:15 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:15.903615 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36619ba-a8cf-4487-ba5b-039748d67554 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:15.906388 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d36619ba-a8cf-4487-ba5b-039748d67554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:15.970205 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36619ba-a8cf-4487-ba5b-039748d67554 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:15.973458 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265205b-4253-4f0c-9a23-44f738d6e6aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6fb4643e93c455c9eb828c52b68bbc3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:15.974038 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265205b-4253-4f0c-9a23-44f738d6e6aa service cinder] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:15.974331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265205b-4253-4f0c-9a23-44f738d6e6aa service cinder] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:15.974617 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265205b-4253-4f0c-9a23-44f738d6e6aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:15.983702 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265205b-4253-4f0c-9a23-44f738d6e6aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:16.009468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265205b-4253-4f0c-9a23-44f738d6e6aa service cinder] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:16.018424 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1391/2811] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:15 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:16.037623 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349511ef-6a16-47c1-a49e-5f450d396496 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:16.118042 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349511ef-6a16-47c1-a49e-5f450d396496 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:16.122374 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:16.124077 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:16.124565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:16.124849 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] PATH_INFO: `/v3/users/3b911d9a0160463ab15af8830f2cb27c` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:16.125984 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b911d9a0160463ab15af8830f2cb27c)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:16.152419 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:16.319383 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b911d9a0160463ab15af8830f2cb27c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:16.320011 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b911d9a0160463ab15af8830f2cb27c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:16.328176 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b911d9a0160463ab15af8830f2cb27c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:16.339426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b911d9a0160463ab15af8830f2cb27c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:16.396935 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b911d9a0160463ab15af8830f2cb27c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:16.403499 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1421/2812] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:24:16 2022] DELETE /identity/v3/users/3b911d9a0160463ab15af8830f2cb27c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:16.408644 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44d7eb-ce6e-4ee9-9bef-70ce77d2d748 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:16.408968 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44d7eb-ce6e-4ee9-9bef-70ce77d2d748 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:16.409254 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44d7eb-ce6e-4ee9-9bef-70ce77d2d748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:16.432169 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-ff44d7eb-ce6e-4ee9-9bef-70ce77d2d748 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:16.433325 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ff44d7eb-ce6e-4ee9-9bef-70ce77d2d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:16.499797 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1392/2813] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:16 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:16.510038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:16.511390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:16.580525 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005635d2-18c0-4c44-a6d6-db83e231500c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:16.584020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59438eae-3e16-41e4-b0c4-163c314a55ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:16.584607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59438eae-3e16-41e4-b0c4-163c314a55ba service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:16.584896 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59438eae-3e16-41e4-b0c4-163c314a55ba service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:16.585180 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59438eae-3e16-41e4-b0c4-163c314a55ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:16.594661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59438eae-3e16-41e4-b0c4-163c314a55ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:16.620630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59438eae-3e16-41e4-b0c4-163c314a55ba service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:16.630829 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1422/2814] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:16 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:17.078608 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44d7eb-ce6e-4ee9-9bef-70ce77d2d748 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:17.080124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-ff44d7eb-ce6e-4ee9-9bef-70ce77d2d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:17.091313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44d7eb-ce6e-4ee9-9bef-70ce77d2d748 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:17.099940 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:17.100723 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:17.101017 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:17.101331 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] PATH_INFO: `/v3/projects/a0eb0c29a9e74200a741d06253505c21` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:17.102742 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0eb0c29a9e74200a741d06253505c21)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:17.130592 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:17.257276 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0eb0c29a9e74200a741d06253505c21', 'request_id': 'req-1ceb2644-b1e5-400a-a883-6ff9194f6823'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:17.346185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0eb0c29a9e74200a741d06253505c21', 'request_id': 'req-1ceb2644-b1e5-400a-a883-6ff9194f6823'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:17.358400 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0eb0c29a9e74200a741d06253505c21', 'request_id': 'req-1ceb2644-b1e5-400a-a883-6ff9194f6823'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:17.368590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] The token cache is being invalidate because project a0eb0c29a9e74200a741d06253505c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66304) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:24:17.368873 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:17.369495 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-1ceb2644-b1e5-400a-a883-6ff9194f6823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:24:17.370900 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1393/2815] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:24:17 2022] DELETE /identity/v3/projects/a0eb0c29a9e74200a741d06253505c21 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:17.380114 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd212-eb64-4a79-8c19-8f9d5e3f2999 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:17.380636 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd212-eb64-4a79-8c19-8f9d5e3f2999 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:17.380750 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd212-eb64-4a79-8c19-8f9d5e3f2999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:17.404016 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-17bbd212-eb64-4a79-8c19-8f9d5e3f2999 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:17.405607 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-17bbd212-eb64-4a79-8c19-8f9d5e3f2999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:17.469729 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1423/2816] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:17.477636 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9473c4-7adb-48fd-8bf0-87bc1f432066 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:17.477933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9473c4-7adb-48fd-8bf0-87bc1f432066 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:17.478219 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9473c4-7adb-48fd-8bf0-87bc1f432066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:17.501437 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-fc9473c4-7adb-48fd-8bf0-87bc1f432066 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:17.502618 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-fc9473c4-7adb-48fd-8bf0-87bc1f432066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:17.511964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1394/2817] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:17 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:17.516824 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbd212-eb64-4a79-8c19-8f9d5e3f2999 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:17.526018 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbd212-eb64-4a79-8c19-8f9d5e3f2999 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:17.530243 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763a4c-6fc9-44b6-a870-8d5cf94badc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:17.530744 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763a4c-6fc9-44b6-a870-8d5cf94badc5 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:17.531029 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763a4c-6fc9-44b6-a870-8d5cf94badc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:17.531327 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763a4c-6fc9-44b6-a870-8d5cf94badc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:17.532012 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10763a4c-6fc9-44b6-a870-8d5cf94badc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=66302) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Jan 18 13:24:17.532304 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10763a4c-6fc9-44b6-a870-8d5cf94badc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:17.558389 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10763a4c-6fc9-44b6-a870-8d5cf94badc5 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:17.573161 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1424/2818] 10.222.0.87 () {58 vars in 1152 bytes} [Tue Jan 18 13:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 18 13:24:17.577755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9473c4-7adb-48fd-8bf0-87bc1f432066 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:17.586572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9473c4-7adb-48fd-8bf0-87bc1f432066 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:17.590943 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d95b90-fe71-4134-a00d-bb2fa201f92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:17.592134 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95b90-fe71-4134-a00d-bb2fa201f92a admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:17.592497 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95b90-fe71-4134-a00d-bb2fa201f92a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:17.592781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d95b90-fe71-4134-a00d-bb2fa201f92a admin admin] PATH_INFO: `/v3/projects` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:17.593413 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d95b90-fe71-4134-a00d-bb2fa201f92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:17.619640 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d95b90-fe71-4134-a00d-bb2fa201f92a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:17.729643 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1395/2819] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:24:17 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:24:17.734224 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763a4c-6fc9-44b6-a870-8d5cf94badc5 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:17.744292 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763a4c-6fc9-44b6-a870-8d5cf94badc5 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:17.807157 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f1ed-5330-4903-a275-08b1cf87afb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:17.807787 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f1ed-5330-4903-a275-08b1cf87afb7 admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:17.808073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f1ed-5330-4903-a275-08b1cf87afb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:17.808353 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2f1ed-5330-4903-a275-08b1cf87afb7 admin admin] PATH_INFO: `/v3/users` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:17.809014 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2f1ed-5330-4903-a275-08b1cf87afb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:17.836487 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2f1ed-5330-4903-a275-08b1cf87afb7 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:17.934944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1425/2820] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:24:17 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:24:17.939114 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d95b90-fe71-4134-a00d-bb2fa201f92a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:17.948893 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d95b90-fe71-4134-a00d-bb2fa201f92a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:17.954417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0a702-f017-4a47-b047-97f82fe2eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:17.955013 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0a702-f017-4a47-b047-97f82fe2eed7 admin admin] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:17.955338 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0a702-f017-4a47-b047-97f82fe2eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:17.955613 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0a702-f017-4a47-b047-97f82fe2eed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:17.956307 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0a702-f017-4a47-b047-97f82fe2eed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:17.985066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0a702-f017-4a47-b047-97f82fe2eed7 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:17.995664 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1396/2821] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:18.000428 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f1ed-5330-4903-a275-08b1cf87afb7 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:18.010960 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2f1ed-5330-4903-a275-08b1cf87afb7 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:18.015509 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d9d14-3498-4501-a8be-eb17f97de8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:18.016312 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9d14-3498-4501-a8be-eb17f97de8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:18.016595 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9d14-3498-4501-a8be-eb17f97de8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:18.016871 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d9d14-3498-4501-a8be-eb17f97de8a8 admin admin] PATH_INFO: `/v3/projects/93e1e08afb504e08834871d5f1256f41/users/cfd873e0df684de2b05d9487c1a3c476/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:18.036003 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d9d14-3498-4501-a8be-eb17f97de8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e1e08afb504e08834871d5f1256f41, user_id=cfd873e0df684de2b05d9487c1a3c476, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:18.063362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d9d14-3498-4501-a8be-eb17f97de8a8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:18.157630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1426/2822] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:17 2022] PUT /identity/v3/projects/93e1e08afb504e08834871d5f1256f41/users/cfd873e0df684de2b05d9487c1a3c476/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:18.162591 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de899e4-6042-40a7-afcc-9d763c5a56c0 None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:18.163076 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de899e4-6042-40a7-afcc-9d763c5a56c0 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:18.163175 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de899e4-6042-40a7-afcc-9d763c5a56c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:18.186369 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-0de899e4-6042-40a7-afcc-9d763c5a56c0 None None] MFA Rules not processed for user `4b6ba909638e4d95a0827152d2079014`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:18.187478 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0de899e4-6042-40a7-afcc-9d763c5a56c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:18.254390 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1397/2823] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:18 2022] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:18.265124 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d9d14-3498-4501-a8be-eb17f97de8a8 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:18.266742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-5e2d9d14-3498-4501-a8be-eb17f97de8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:18.330978 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d9d14-3498-4501-a8be-eb17f97de8a8 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:18.334375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4bbda-d17b-4492-a080-2986292098bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:18.334966 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4bbda-d17b-4492-a080-2986292098bf service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:18.335253 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4bbda-d17b-4492-a080-2986292098bf service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:18.335562 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4bbda-d17b-4492-a080-2986292098bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:18.345117 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4bbda-d17b-4492-a080-2986292098bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:18.370846 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4bbda-d17b-4492-a080-2986292098bf service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:18.380363 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1427/2824] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:18 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:24.886184 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8eb3-7828-4534-b4bc-29f45679402d None None] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:24.886642 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8eb3-7828-4534-b4bc-29f45679402d None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:24.886899 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e8eb3-7828-4534-b4bc-29f45679402d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:24.927434 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.auth.core [None req-e07e8eb3-7828-4534-b4bc-29f45679402d None None] MFA Rules not processed for user `cfd873e0df684de2b05d9487c1a3c476`. Rule list: `[]` (Enabled: `True`). {{(pid=66304) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:24.928627 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e07e8eb3-7828-4534-b4bc-29f45679402d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:25.025335 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1398/2825] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:24 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:25.030620 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4bbda-d17b-4492-a080-2986292098bf service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:25.040469 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4bbda-d17b-4492-a080-2986292098bf service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:25.045662 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce76dc-baf0-4e19-a75a-eb7317b976bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:25.046573 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce76dc-baf0-4e19-a75a-eb7317b976bc admin admin] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:25.046968 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce76dc-baf0-4e19-a75a-eb7317b976bc admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:25.047347 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce76dc-baf0-4e19-a75a-eb7317b976bc admin admin] PATH_INFO: `/v3/projects` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:25.048073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce76dc-baf0-4e19-a75a-eb7317b976bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:25.074784 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ce76dc-baf0-4e19-a75a-eb7317b976bc admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:25.179753 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1428/2826] 10.222.0.87 () {60 vars in 1152 bytes} [Tue Jan 18 13:24:25 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:24:25.181069 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e8eb3-7828-4534-b4bc-29f45679402d None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:25.192855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e8eb3-7828-4534-b4bc-29f45679402d None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:25.261217 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05711d2-c93b-46b2-b7ee-b552d01d76d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:25.261827 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05711d2-c93b-46b2-b7ee-b552d01d76d8 admin admin] REQUEST_METHOD: `POST` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:25.262111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05711d2-c93b-46b2-b7ee-b552d01d76d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:25.262655 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05711d2-c93b-46b2-b7ee-b552d01d76d8 admin admin] PATH_INFO: `/v3/users` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:25.263974 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05711d2-c93b-46b2-b7ee-b552d01d76d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:25.289710 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05711d2-c93b-46b2-b7ee-b552d01d76d8 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:25.376482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1399/2827] 10.222.0.87 () {60 vars in 1143 bytes} [Tue Jan 18 13:24:25 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 18 13:24:25.380371 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce76dc-baf0-4e19-a75a-eb7317b976bc admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:25.391890 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce76dc-baf0-4e19-a75a-eb7317b976bc admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:25.397080 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793271d4-ab37-48af-a944-4ce828caaee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:25.397686 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793271d4-ab37-48af-a944-4ce828caaee0 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:25.397880 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793271d4-ab37-48af-a944-4ce828caaee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:25.398217 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793271d4-ab37-48af-a944-4ce828caaee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:25.398917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793271d4-ab37-48af-a944-4ce828caaee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:25.425596 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793271d4-ab37-48af-a944-4ce828caaee0 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:25.437200 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1429/2828] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:25.441566 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05711d2-c93b-46b2-b7ee-b552d01d76d8 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:25.454809 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05711d2-c93b-46b2-b7ee-b552d01d76d8 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:25.459472 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead5974-a4c9-4d0e-b1a7-e226057adeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:25.460396 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5974-a4c9-4d0e-b1a7-e226057adeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:25.460754 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5974-a4c9-4d0e-b1a7-e226057adeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:25.461105 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5974-a4c9-4d0e-b1a7-e226057adeb2 admin admin] PATH_INFO: `/v3/projects/eeffd3146af24bb28fca28dd239fdd8a/users/f4870dd9352a42b3a51e367adf0afd80/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:25.484518 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead5974-a4c9-4d0e-b1a7-e226057adeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeffd3146af24bb28fca28dd239fdd8a, user_id=f4870dd9352a42b3a51e367adf0afd80, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:25.512051 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead5974-a4c9-4d0e-b1a7-e226057adeb2 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:25.586242 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1400/2829] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:25 2022] PUT /identity/v3/projects/eeffd3146af24bb28fca28dd239fdd8a/users/f4870dd9352a42b3a51e367adf0afd80/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:25.590159 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793271d4-ab37-48af-a944-4ce828caaee0 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:25.599834 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793271d4-ab37-48af-a944-4ce828caaee0 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:25.665955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff29c7b-2c0b-4ffd-a7b6-72638796ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:25.666554 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff29c7b-2c0b-4ffd-a7b6-72638796ec46 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:25.666844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff29c7b-2c0b-4ffd-a7b6-72638796ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:25.667127 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff29c7b-2c0b-4ffd-a7b6-72638796ec46 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:25.667859 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff29c7b-2c0b-4ffd-a7b6-72638796ec46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:25.696230 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff29c7b-2c0b-4ffd-a7b6-72638796ec46 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:25.706334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1430/2830] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:25.710675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead5974-a4c9-4d0e-b1a7-e226057adeb2 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:25.721820 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead5974-a4c9-4d0e-b1a7-e226057adeb2 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:25.726296 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477e4f1-1f60-48e1-abbc-a2ef67936f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:25.727125 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477e4f1-1f60-48e1-abbc-a2ef67936f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:25.727448 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477e4f1-1f60-48e1-abbc-a2ef67936f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:25.727755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b477e4f1-1f60-48e1-abbc-a2ef67936f6a admin admin] PATH_INFO: `/v3/projects/eeffd3146af24bb28fca28dd239fdd8a/users/f4870dd9352a42b3a51e367adf0afd80/roles/585c4928fc0d4e72b6dce5e8e9f5865e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:25.730043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477e4f1-1f60-48e1-abbc-a2ef67936f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeffd3146af24bb28fca28dd239fdd8a, user_id=f4870dd9352a42b3a51e367adf0afd80, role_id=585c4928fc0d4e72b6dce5e8e9f5865e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:25.756749 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b477e4f1-1f60-48e1-abbc-a2ef67936f6a admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:25.769775 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1401/2831] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:25 2022] PUT /identity/v3/projects/eeffd3146af24bb28fca28dd239fdd8a/users/f4870dd9352a42b3a51e367adf0afd80/roles/585c4928fc0d4e72b6dce5e8e9f5865e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:25.773865 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff29c7b-2c0b-4ffd-a7b6-72638796ec46 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:25.784067 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff29c7b-2c0b-4ffd-a7b6-72638796ec46 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:25.846990 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd71e86-40bd-4c4c-9af4-9e76376b0423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:25.847629 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd71e86-40bd-4c4c-9af4-9e76376b0423 admin admin] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:25.847916 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd71e86-40bd-4c4c-9af4-9e76376b0423 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:25.848193 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd71e86-40bd-4c4c-9af4-9e76376b0423 admin admin] PATH_INFO: `/v3/roles` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:25.848943 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd71e86-40bd-4c4c-9af4-9e76376b0423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:25.874962 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd71e86-40bd-4c4c-9af4-9e76376b0423 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:25.885693 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1431/2832] 10.222.0.87 () {58 vars in 1121 bytes} [Tue Jan 18 13:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 18 13:24:25.890842 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477e4f1-1f60-48e1-abbc-a2ef67936f6a admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:25.900731 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b477e4f1-1f60-48e1-abbc-a2ef67936f6a admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:25.905274 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb9f4-4657-4da1-8454-fb39ef887132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:25.906098 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb9f4-4657-4da1-8454-fb39ef887132 admin admin] REQUEST_METHOD: `PUT` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:25.906386 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb9f4-4657-4da1-8454-fb39ef887132 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:25.906700 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb9f4-4657-4da1-8454-fb39ef887132 admin admin] PATH_INFO: `/v3/projects/eeffd3146af24bb28fca28dd239fdd8a/users/f4870dd9352a42b3a51e367adf0afd80/roles/8446160cb99a4e83afec03d9b67986b6` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:25.908461 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb9f4-4657-4da1-8454-fb39ef887132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeffd3146af24bb28fca28dd239fdd8a, user_id=f4870dd9352a42b3a51e367adf0afd80, role_id=8446160cb99a4e83afec03d9b67986b6)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:25.935653 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb9f4-4657-4da1-8454-fb39ef887132 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:26.022251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1402/2833] 10.222.0.87 () {60 vars in 1482 bytes} [Tue Jan 18 13:24:25 2022] PUT /identity/v3/projects/eeffd3146af24bb28fca28dd239fdd8a/users/f4870dd9352a42b3a51e367adf0afd80/roles/8446160cb99a4e83afec03d9b67986b6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:24:32.570561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfabf41-f236-47b0-9d71-635d7a9fb1cc None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:32.571220 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfabf41-f236-47b0-9d71-635d7a9fb1cc None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:32.571220 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfabf41-f236-47b0-9d71-635d7a9fb1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:32.607932 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-bcfabf41-f236-47b0-9d71-635d7a9fb1cc None None] MFA Rules not processed for user `f4870dd9352a42b3a51e367adf0afd80`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:32.609072 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-bcfabf41-f236-47b0-9d71-635d7a9fb1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:32.684836 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1432/2834] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:32 2022] POST /identity/v3/auth/tokens => generated 3747 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:32.696906 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb9f4-4657-4da1-8454-fb39ef887132 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:32.698483 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-433bb9f4-4657-4da1-8454-fb39ef887132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:32.791641 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb9f4-4657-4da1-8454-fb39ef887132 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:32.797124 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561eb35-3fed-457b-b864-892d97e244a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:32.797705 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561eb35-3fed-457b-b864-892d97e244a6 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:32.797997 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561eb35-3fed-457b-b864-892d97e244a6 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:32.798278 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561eb35-3fed-457b-b864-892d97e244a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:32.866910 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561eb35-3fed-457b-b864-892d97e244a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:32.893209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561eb35-3fed-457b-b864-892d97e244a6 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:32.902154 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1403/2835] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:32 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:35.883152 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc46b2-c2ad-49b2-9db3-df7cf0c8dddd None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:35.883719 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc46b2-c2ad-49b2-9db3-df7cf0c8dddd None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:35.883852 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc46b2-c2ad-49b2-9db3-df7cf0c8dddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:35.910616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-59cc46b2-c2ad-49b2-9db3-df7cf0c8dddd None None] MFA Rules not processed for user `cfd873e0df684de2b05d9487c1a3c476`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:24:35.911802 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-59cc46b2-c2ad-49b2-9db3-df7cf0c8dddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:35.920616 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1433/2836] 10.222.0.87 () {58 vars in 957 bytes} [Tue Jan 18 13:24:35 2022] POST /identity/v3/auth/tokens => generated 3678 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 18 13:24:50.700111 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561eb35-3fed-457b-b864-892d97e244a6 service nova] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:50.701659 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-1561eb35-3fed-457b-b864-892d97e244a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:50.785757 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561eb35-3fed-457b-b864-892d97e244a6 service nova] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:50.789228 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dceaf8-57d3-423b-a023-0553ea1ff7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:50.789817 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dceaf8-57d3-423b-a023-0553ea1ff7cd service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:50.790099 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dceaf8-57d3-423b-a023-0553ea1ff7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:50.790375 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dceaf8-57d3-423b-a023-0553ea1ff7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:50.801301 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dceaf8-57d3-423b-a023-0553ea1ff7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:50.828696 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dceaf8-57d3-423b-a023-0553ea1ff7cd service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:50.854030 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1404/2837] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:50 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:24:52.369112 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc46b2-c2ad-49b2-9db3-df7cf0c8dddd None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:24:52.379689 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc46b2-c2ad-49b2-9db3-df7cf0c8dddd None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:24:52.383038 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:24:52.383655 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:24:52.383944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:24:52.384225 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:24:52.385904 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:24:52.418106 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:24:52.443097 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:24:52.454536 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1434/2838] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:24:52 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:25:01.136248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dceaf8-57d3-423b-a023-0553ea1ff7cd service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:01.147427 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dceaf8-57d3-423b-a023-0553ea1ff7cd service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:01.152933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:01.153611 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:01.154027 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:01.154477 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:01.156452 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:01.172249 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:01.198706 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:01.214418 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1405/2839] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:25:01 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:25:01.240446 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:01.242113 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:01.334676 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2660273-f48e-47e0-a99a-c0f4bd159559 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:01.340073 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7576-136c-461b-b960-3b27c1807131 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:01.340889 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7576-136c-461b-b960-3b27c1807131 service placement] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:01.341315 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7576-136c-461b-b960-3b27c1807131 service placement] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:01.341866 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a7576-136c-461b-b960-3b27c1807131 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:01.343772 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-fd1a7576-136c-461b-b960-3b27c1807131 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:01.355605 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7576-136c-461b-b960-3b27c1807131 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:01.384481 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a7576-136c-461b-b960-3b27c1807131 service placement] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:01.395630 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1435/2840] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:25:01 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:25:01.504741 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:01.506506 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:01.521781 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec6ef-a818-40d1-91e3-bb2b10792ca3 service nova] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:01.532925 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ebc2f-df89-4f96-bad2-93745e448daf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:01.533616 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebc2f-df89-4f96-bad2-93745e448daf service placement] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:01.534077 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebc2f-df89-4f96-bad2-93745e448daf service placement] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:01.534328 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265ebc2f-df89-4f96-bad2-93745e448daf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:01.536302 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-265ebc2f-df89-4f96-bad2-93745e448daf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:01.549471 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ebc2f-df89-4f96-bad2-93745e448daf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:01.576844 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265ebc2f-df89-4f96-bad2-93745e448daf service placement] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:01.587152 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1406/2841] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:25:01 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:25:07.421375 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7576-136c-461b-b960-3b27c1807131 service placement] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:07.436648 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a7576-136c-461b-b960-3b27c1807131 service placement] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:07.440262 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245476d5-1ce4-4c94-b2ab-345f7987fd18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:07.440967 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245476d5-1ce4-4c94-b2ab-345f7987fd18 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:07.441260 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245476d5-1ce4-4c94-b2ab-345f7987fd18 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:07.441543 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245476d5-1ce4-4c94-b2ab-345f7987fd18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:07.445195 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-245476d5-1ce4-4c94-b2ab-345f7987fd18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:07.456201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245476d5-1ce4-4c94-b2ab-345f7987fd18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:07.483406 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245476d5-1ce4-4c94-b2ab-345f7987fd18 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:07.492457 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1436/2842] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:25:07 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:25:09.100188 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ebc2f-df89-4f96-bad2-93745e448daf service placement] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:09.113964 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265ebc2f-df89-4f96-bad2-93745e448daf service placement] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:09.117408 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:09.117996 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:09.118305 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:09.118572 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:09.120451 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:09.200246 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:09.226755 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:09.238344 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1407/2843] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:25:09 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:25:22.596569 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245476d5-1ce4-4c94-b2ab-345f7987fd18 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:22.606061 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245476d5-1ce4-4c94-b2ab-345f7987fd18 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:22.610248 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfc6a7-c314-46b7-9a1c-7f7845ea6b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:22.610826 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfc6a7-c314-46b7-9a1c-7f7845ea6b53 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:22.611116 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfc6a7-c314-46b7-9a1c-7f7845ea6b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:22.611429 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfc6a7-c314-46b7-9a1c-7f7845ea6b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:22.620805 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfc6a7-c314-46b7-9a1c-7f7845ea6b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:22.648081 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfc6a7-c314-46b7-9a1c-7f7845ea6b53 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:22.661320 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1437/2844] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:25:22 2022] GET /identity/v3/auth/tokens => generated 3747 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:25:22.663902 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:22.666172 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:22.686880 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5a971-41ca-4978-a65a-d45a32baf122 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:22.691456 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:22.692362 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:22.692663 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:22.692953 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] PATH_INFO: `/v3/users/a3dd76d6bced43f696d43e9f559e854e` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:22.713735 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3dd76d6bced43f696d43e9f559e854e)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:22.741123 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:22.983545 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3dd76d6bced43f696d43e9f559e854e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:22.995948 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3dd76d6bced43f696d43e9f559e854e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:22.996587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3dd76d6bced43f696d43e9f559e854e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:23.005417 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3dd76d6bced43f696d43e9f559e854e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:23.082482 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3dd76d6bced43f696d43e9f559e854e'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:23.089603 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1408/2845] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:25:22 2022] DELETE /identity/v3/users/a3dd76d6bced43f696d43e9f559e854e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:25:23.416742 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfc6a7-c314-46b7-9a1c-7f7845ea6b53 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:23.428869 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfc6a7-c314-46b7-9a1c-7f7845ea6b53 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:23.508841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:23.510089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:23.510089 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:23.510298 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] PATH_INFO: `/v3/projects/a0cf2555372d4833a1b2cbdd625d2186` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:23.522877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0cf2555372d4833a1b2cbdd625d2186)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:23.551155 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:23.667500 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0cf2555372d4833a1b2cbdd625d2186', 'request_id': 'req-4cfdc566-a8ce-4da4-b9b4-c877735652c6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:23.733659 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0cf2555372d4833a1b2cbdd625d2186', 'request_id': 'req-4cfdc566-a8ce-4da4-b9b4-c877735652c6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:23.745390 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0cf2555372d4833a1b2cbdd625d2186', 'request_id': 'req-4cfdc566-a8ce-4da4-b9b4-c877735652c6'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:23.756099 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] The token cache is being invalidate because project a0cf2555372d4833a1b2cbdd625d2186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:25:23.757665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:23.757665 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:23.758496 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1438/2846] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:25:23 2022] DELETE /identity/v3/projects/a0cf2555372d4833a1b2cbdd625d2186 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:25:23.764160 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:23.765590 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:23.778226 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d574802-c8d3-42bc-86bc-5c533708e1d1 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:23.849186 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:23.850043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:23.850332 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:23.850621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] PATH_INFO: `/v3/users/6e842d84327242988b38f13a9a4ac51d` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:23.876193 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e842d84327242988b38f13a9a4ac51d)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:23.904313 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:24.107284 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e842d84327242988b38f13a9a4ac51d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:24.121733 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e842d84327242988b38f13a9a4ac51d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:24.123075 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e842d84327242988b38f13a9a4ac51d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:24.132256 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e842d84327242988b38f13a9a4ac51d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:24.219245 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e842d84327242988b38f13a9a4ac51d'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:24.226282 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1409/2847] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:25:23 2022] DELETE /identity/v3/users/6e842d84327242988b38f13a9a4ac51d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 18 13:25:24.668326 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:25:24.670621 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:25:24.683672 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc566-a8ce-4da4-b9b4-c877735652c6 admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:25:24.756597 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:25:24.757427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:25:24.757724 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:25:24.758035 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] PATH_INFO: `/v3/projects/c5d34056ac47431ea8f999da61b3fe87` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:25:24.778071 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5d34056ac47431ea8f999da61b3fe87)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:25:24.805855 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:25:24.909561 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5d34056ac47431ea8f999da61b3fe87', 'request_id': 'req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:24.979426 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5d34056ac47431ea8f999da61b3fe87', 'request_id': 'req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:24.992955 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5d34056ac47431ea8f999da61b3fe87', 'request_id': 'req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:25.004944 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] The token cache is being invalidate because project c5d34056ac47431ea8f999da61b3fe87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:25:25.005366 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:25.006178 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:25:25.007741 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1439/2848] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:25:24 2022] DELETE /identity/v3/projects/c5d34056ac47431ea8f999da61b3fe87 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:27:55.038652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:27:55.040122 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:27:55.113366 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c6801c-2570-4b4f-bcef-c08f38f267c5 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:27:55.170185 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:27:55.170782 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:27:55.171067 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:27:55.171575 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:27:55.173251 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:27:55.183587 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:27:55.209739 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:27:55.218395 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1410/2849] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:27:55 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 18 13:27:57.320661 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:27:57.322125 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:27:57.402574 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3141e-8cdd-48c2-9b3b-19e5552d08fe admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:27:57.407843 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79e012-4fe0-4a17-882f-1e75487018ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:27:57.408431 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79e012-4fe0-4a17-882f-1e75487018ae service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:27:57.408716 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79e012-4fe0-4a17-882f-1e75487018ae service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:27:57.408997 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79e012-4fe0-4a17-882f-1e75487018ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:27:57.410760 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-8a79e012-4fe0-4a17-882f-1e75487018ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:27:57.422640 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79e012-4fe0-4a17-882f-1e75487018ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:27:57.449044 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79e012-4fe0-4a17-882f-1e75487018ae service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:27:57.459822 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1440/2850] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:27:57 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:28:45.704704 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:28:45.706908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:28:45.785311 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e1297-e502-4613-8882-a7e28b929c87 service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:28:45.790965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:28:45.791591 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:28:45.791884 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:28:45.792167 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:28:45.793908 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:28:45.806209 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:28:45.844189 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:28:45.855678 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1411/2851] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:28:45 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:29:32.953309 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79e012-4fe0-4a17-882f-1e75487018ae service nova] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:29:32.964877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79e012-4fe0-4a17-882f-1e75487018ae service nova] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:29:32.970255 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a2717-83e6-4798-8c77-af6da7ae7c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:29:32.970841 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a2717-83e6-4798-8c77-af6da7ae7c1f service nova] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:29:32.971129 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a2717-83e6-4798-8c77-af6da7ae7c1f service nova] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:29:32.971447 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a2717-83e6-4798-8c77-af6da7ae7c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:29:32.973767 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d98a2717-83e6-4798-8c77-af6da7ae7c1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:29:33.046020 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a2717-83e6-4798-8c77-af6da7ae7c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:29:33.072478 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a2717-83e6-4798-8c77-af6da7ae7c1f service nova] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:29:33.081752 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1441/2852] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:29:32 2022] GET /identity/v3/auth/tokens => generated 3678 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:29:52.103171 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:29:52.104625 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:29:52.116744 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846f136-d6dc-4ba7-ac81-da1f89c3f20f service placement] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:29:52.120218 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010afd6b-22b8-4bd5-93f5-e6860798ae11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:29:52.120800 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010afd6b-22b8-4bd5-93f5-e6860798ae11 service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:29:52.121089 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010afd6b-22b8-4bd5-93f5-e6860798ae11 service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:29:52.121374 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010afd6b-22b8-4bd5-93f5-e6860798ae11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:29:52.123234 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-010afd6b-22b8-4bd5-93f5-e6860798ae11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:29:52.137463 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010afd6b-22b8-4bd5-93f5-e6860798ae11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:29:52.163132 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010afd6b-22b8-4bd5-93f5-e6860798ae11 service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:29:52.175081 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1412/2853] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:29:52 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:29:53.447293 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a2717-83e6-4798-8c77-af6da7ae7c1f service nova] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:29:53.457877 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a2717-83e6-4798-8c77-af6da7ae7c1f service nova] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:29:53.461334 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c0913-74f0-4f8d-9338-c39b9747adc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:29:53.461918 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c0913-74f0-4f8d-9338-c39b9747adc3 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:29:53.462207 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c0913-74f0-4f8d-9338-c39b9747adc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:29:53.462492 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c0913-74f0-4f8d-9338-c39b9747adc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:29:53.473666 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c0913-74f0-4f8d-9338-c39b9747adc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:29:53.498628 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c0913-74f0-4f8d-9338-c39b9747adc3 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:29:53.509868 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1442/2854] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:29:53 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:30:56.089557 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f498d-c84c-4c19-b8f6-ce206a7f7ef2 None None] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:30:56.090565 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f498d-c84c-4c19-b8f6-ce206a7f7ef2 None None] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:30:56.090855 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f498d-c84c-4c19-b8f6-ce206a7f7ef2 None None] PATH_INFO: `/` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:30:56.092614 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1413/2855] 10.222.0.87 () {54 vars in 921 bytes} [Tue Jan 18 13:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 18 13:30:56.098318 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e1dd5-1c2c-4c7e-a816-bc2beb1a95f0 None None] REQUEST_METHOD: `POST` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:30:56.098791 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e1dd5-1c2c-4c7e-a816-bc2beb1a95f0 None None] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:30:56.098908 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e1dd5-1c2c-4c7e-a816-bc2beb1a95f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:30:56.166439 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.auth.core [None req-d80e1dd5-1c2c-4c7e-a816-bc2beb1a95f0 None None] MFA Rules not processed for user `cb93a689fc8b4aaab37c8fa4f9a08d64`. Rule list: `[]` (Enabled: `True`). {{(pid=66302) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 18 13:30:56.167622 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d80e1dd5-1c2c-4c7e-a816-bc2beb1a95f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:30:56.173738 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1443/2856] 10.222.0.87 () {58 vars in 1018 bytes} [Tue Jan 18 13:30:56 2022] POST /identity/v3/auth/tokens => generated 3551 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 18 13:30:56.186485 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f498d-c84c-4c19-b8f6-ce206a7f7ef2 None None] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:30:56.198794 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f498d-c84c-4c19-b8f6-ce206a7f7ef2 None None] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:30:56.202468 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e916c0-36af-43d4-8eaf-3585c336e17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:30:56.203059 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e916c0-36af-43d4-8eaf-3585c336e17c service neutron] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:30:56.203933 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e916c0-36af-43d4-8eaf-3585c336e17c service neutron] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:30:56.204950 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e916c0-36af-43d4-8eaf-3585c336e17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:30:56.213055 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e916c0-36af-43d4-8eaf-3585c336e17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:30:56.240043 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e916c0-36af-43d4-8eaf-3585c336e17c service neutron] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:30:56.248888 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1414/2857] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:30:56 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:30:56.363030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e1dd5-1c2c-4c7e-a816-bc2beb1a95f0 None None] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:30:56.364386 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-d80e1dd5-1c2c-4c7e-a816-bc2beb1a95f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:30:56.380404 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e1dd5-1c2c-4c7e-a816-bc2beb1a95f0 None None] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:30:56.385172 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07725828-2b96-458b-a700-8cdfdb09a432 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:30:56.385745 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07725828-2b96-458b-a700-8cdfdb09a432 service placement] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:30:56.386030 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07725828-2b96-458b-a700-8cdfdb09a432 service placement] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:30:56.386307 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07725828-2b96-458b-a700-8cdfdb09a432 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:30:56.387964 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-07725828-2b96-458b-a700-8cdfdb09a432 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:30:56.399601 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07725828-2b96-458b-a700-8cdfdb09a432 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:30:56.425427 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07725828-2b96-458b-a700-8cdfdb09a432 service placement] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:30:56.435653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1444/2858] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:30:56 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:30:56.536507 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e916c0-36af-43d4-8eaf-3585c336e17c service neutron] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:30:56.548726 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e916c0-36af-43d4-8eaf-3585c336e17c service neutron] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:30:56.553392 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216cfa0-0d2a-4f7e-b7a5-c817a4dd864f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:30:56.553965 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216cfa0-0d2a-4f7e-b7a5-c817a4dd864f service placement] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:30:56.554248 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216cfa0-0d2a-4f7e-b7a5-c817a4dd864f service placement] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:30:56.554528 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216cfa0-0d2a-4f7e-b7a5-c817a4dd864f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:30:56.556187 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-0216cfa0-0d2a-4f7e-b7a5-c817a4dd864f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:30:56.567156 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216cfa0-0d2a-4f7e-b7a5-c817a4dd864f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:30:56.593128 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216cfa0-0d2a-4f7e-b7a5-c817a4dd864f service placement] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:30:56.604104 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1415/2859] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:30:56 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:30:58.999547 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07725828-2b96-458b-a700-8cdfdb09a432 service placement] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:30:59.009888 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07725828-2b96-458b-a700-8cdfdb09a432 service placement] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:30:59.014432 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc4fbb-3338-4ceb-a6cf-3b38e5cebb58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:30:59.014956 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc4fbb-3338-4ceb-a6cf-3b38e5cebb58 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:30:59.015247 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc4fbb-3338-4ceb-a6cf-3b38e5cebb58 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:30:59.017110 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc4fbb-3338-4ceb-a6cf-3b38e5cebb58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:30:59.018653 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-b3dc4fbb-3338-4ceb-a6cf-3b38e5cebb58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:30:59.029983 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc4fbb-3338-4ceb-a6cf-3b38e5cebb58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:30:59.056401 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc4fbb-3338-4ceb-a6cf-3b38e5cebb58 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:30:59.067146 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1445/2860] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:30:58 2022] GET /identity/v3/auth/tokens => generated 3551 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:32:44.881263 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216cfa0-0d2a-4f7e-b7a5-c817a4dd864f service placement] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:32:44.938795 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216cfa0-0d2a-4f7e-b7a5-c817a4dd864f service placement] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:32:44.944281 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '394a96c082ed47bbbd645b489a4ed208', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:32:44.944958 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:32:44.945315 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:32:44.945683 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:32:44.948183 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:32:44.984241 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:32:45.010812 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:32:45.022914 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1416/2861] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:32:44 2022] GET /identity/v3/auth/tokens => generated 3802 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:32:51.280466 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc4fbb-3338-4ceb-a6cf-3b38e5cebb58 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:32:51.319825 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc4fbb-3338-4ceb-a6cf-3b38e5cebb58 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:32:51.323201 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11a299-a0a2-4477-ac65-1b16fac94ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb93a689fc8b4aaab37c8fa4f9a08d64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:32:51.323801 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11a299-a0a2-4477-ac65-1b16fac94ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:32:51.324086 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11a299-a0a2-4477-ac65-1b16fac94ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:32:51.324362 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11a299-a0a2-4477-ac65-1b16fac94ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:32:51.327048 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-3b11a299-a0a2-4477-ac65-1b16fac94ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:32:51.397053 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11a299-a0a2-4477-ac65-1b16fac94ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:32:51.423133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11a299-a0a2-4477-ac65-1b16fac94ce7 service neutron] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:32:51.433289 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1446/2862] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:32:51 2022] GET /identity/v3/auth/tokens => generated 3669 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 18 13:33:04.317621 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:33:04.319066 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:33:04.332052 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7378c-fe55-494a-8a25-f523d5e383fb service nova] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:33:04.336323 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:33:04.337118 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:33:04.337402 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:33:04.337679 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] PATH_INFO: `/v3/users/cfd873e0df684de2b05d9487c1a3c476` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:33:04.338758 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd873e0df684de2b05d9487c1a3c476)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:33:04.365267 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:33:04.639292 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd873e0df684de2b05d9487c1a3c476'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:04.651387 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd873e0df684de2b05d9487c1a3c476'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:04.652063 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd873e0df684de2b05d9487c1a3c476'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:04.659675 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd873e0df684de2b05d9487c1a3c476'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:04.803777 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd873e0df684de2b05d9487c1a3c476'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:04.810856 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1417/2863] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:33:04 2022] DELETE /identity/v3/users/cfd873e0df684de2b05d9487c1a3c476 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:33:05.122212 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11a299-a0a2-4477-ac65-1b16fac94ce7 service neutron] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:33:05.134096 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11a299-a0a2-4477-ac65-1b16fac94ce7 service neutron] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:33:05.200844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:33:05.201565 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:33:05.201864 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:33:05.202133 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] PATH_INFO: `/v3/projects/93e1e08afb504e08834871d5f1256f41` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:33:05.203215 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e1e08afb504e08834871d5f1256f41)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:33:05.230227 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:33:05.411400 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e1e08afb504e08834871d5f1256f41', 'request_id': 'req-9ad0b378-0de3-4505-9b14-e3df2c8a764c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:05.532540 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e1e08afb504e08834871d5f1256f41', 'request_id': 'req-9ad0b378-0de3-4505-9b14-e3df2c8a764c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:05.547780 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e1e08afb504e08834871d5f1256f41', 'request_id': 'req-9ad0b378-0de3-4505-9b14-e3df2c8a764c'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:05.557958 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] The token cache is being invalidate because project 93e1e08afb504e08834871d5f1256f41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:33:05.558235 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:05.558917 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:05.560505 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1447/2864] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:33:05 2022] DELETE /identity/v3/projects/93e1e08afb504e08834871d5f1256f41 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:33:05.565017 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:33:05.565993 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:33:05.578978 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf84a32-12a4-4522-a4b9-49e343ebfa99 admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:33:05.642222 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:33:05.643032 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:33:05.643339 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:33:05.643666 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] PATH_INFO: `/v3/users/f4870dd9352a42b3a51e367adf0afd80` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:33:05.644804 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4870dd9352a42b3a51e367adf0afd80)` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:33:05.671719 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:33:05.883593 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4870dd9352a42b3a51e367adf0afd80'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:05.896738 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4870dd9352a42b3a51e367adf0afd80'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:05.897411 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4870dd9352a42b3a51e367adf0afd80'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:05.905652 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4870dd9352a42b3a51e367adf0afd80'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:06.043291 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.notifications [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4870dd9352a42b3a51e367adf0afd80'} {{(pid=66304) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:06.049686 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1418/2865] 10.222.0.87 () {58 vars in 1223 bytes} [Tue Jan 18 13:33:05 2022] DELETE /identity/v3/users/f4870dd9352a42b3a51e367adf0afd80 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:33:06.376145 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] Authenticating user token {{(pid=66302) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:33:06.384506 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.fernet_utils [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66302) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:33:06.392417 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0b378-0de3-4505-9b14-e3df2c8a764c admin admin] Validating token access rules against request {{(pid=66302) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:33:06.456524 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b6ba909638e4d95a0827152d2079014', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efd990fcb71545ffb5735fe49db625b4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66302) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:33:06.457197 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:33:06.457483 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:33:06.457766 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] PATH_INFO: `/v3/projects/eeffd3146af24bb28fca28dd239fdd8a` {{(pid=66302) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:33:06.458844 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeffd3146af24bb28fca28dd239fdd8a)` {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:33:06.484833 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] RBAC: Authorization granted {{(pid=66302) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:33:06.642433 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeffd3146af24bb28fca28dd239fdd8a', 'request_id': 'req-d23183e5-6b75-4ac8-8c3f-c6610008eef8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:06.716204 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeffd3146af24bb28fca28dd239fdd8a', 'request_id': 'req-d23183e5-6b75-4ac8-8c3f-c6610008eef8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:06.730079 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeffd3146af24bb28fca28dd239fdd8a', 'request_id': 'req-d23183e5-6b75-4ac8-8c3f-c6610008eef8'} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:06.742265 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] The token cache is being invalidate because project eeffd3146af24bb28fca28dd239fdd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=66302) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 18 13:33:06.742540 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:06.743181 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: DEBUG keystone.notifications [None req-d23183e5-6b75-4ac8-8c3f-c6610008eef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=66302) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 18 13:33:06.744650 dv-cinder-825102-1-iscsi devstack@keystone.service[66302]: [pid: 66302|app: 0|req: 1448/2866] 10.222.0.87 () {58 vars in 1232 bytes} [Tue Jan 18 13:33:06 2022] DELETE /identity/v3/projects/eeffd3146af24bb28fca28dd239fdd8a => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 18 13:33:51.696862 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] Authenticating user token {{(pid=66304) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 18 13:33:51.698763 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:33:51.803721 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f918dd-02f6-46f5-a187-750816beb1fd admin admin] Validating token access rules against request {{(pid=66304) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 18 13:33:51.868588 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431877d-3d38-469d-9602-968c1b8da4d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a678f789e3549a3b634acc510c5d0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5033ab9f12174889a76d7c4ef0bfd997', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=66304) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 18 13:33:51.869174 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431877d-3d38-469d-9602-968c1b8da4d0 service placement] REQUEST_METHOD: `GET` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 18 13:33:51.869462 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431877d-3d38-469d-9602-968c1b8da4d0 service placement] SCRIPT_NAME: `/identity` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 18 13:33:51.869810 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431877d-3d38-469d-9602-968c1b8da4d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=66304) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 18 13:33:51.872533 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.fernet_utils [None req-8431877d-3d38-469d-9602-968c1b8da4d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=66304) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 18 13:33:51.883522 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431877d-3d38-469d-9602-968c1b8da4d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Jan 18 13:33:51.909658 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431877d-3d38-469d-9602-968c1b8da4d0 service placement] RBAC: Authorization granted {{(pid=66304) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 18 13:33:51.919404 dv-cinder-825102-1-iscsi devstack@keystone.service[66304]: [pid: 66304|app: 0|req: 1419/2867] 10.222.0.87 () {60 vars in 1365 bytes} [Tue Jan 18 13:33:51 2022] GET /identity/v3/auth/tokens => generated 3738 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)